Recording medium, reproducing device for providing service based on data of recording medium, and method thereof

ABSTRACT

A reproducing device is provided. The reproducing device includes: a driver configured to load a recording medium in response to the recording medium being attached, wherein the recording medium records video data and additional information encoded according to a High Efficiency Video Coding (HEVC) method; a data processor configured to process the video data; a controller configured to provide a service corresponding to the additional information. The service includes at least one of a trick play service, an interested region enlargement service, and an object adjusting service.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims priority from U.S. Provisional PatentApplication No. 61/721,148, filed on Nov. 1, 2012, in the United Statespatent and Trademark Office, and Korean Patent Application No.10-2013-0063630, filed on Jun. 3, 2013, in the Korean IntellectualProperty Office, the entire disclosure of which is hereby incorporatedby reference.

BACKGROUND

1. Field

Exemplary embodiments relate to providing a recording medium, areproducing device, and a method of providing a service thereof. Inparticular, exemplary embodiments relate to providing a recording mediumthat records data, a reproducing device for providing various types ofservices based on the data, and a method thereof.

2. Description of the Related Art

With the development of electronic technology, various types of productshave been developed and sold to consumers.

According to user needs for various types of contents, size requirementsof contents processed in electronic devices have greatly increased.Further, a mass of contents, such as various types of 3-dimension (3D)contents or Ultrahigh Definition (UHD) contents, have been used.

These various types of contents may be recorded and provided on varioustypes of recording media. If a recording medium is loaded, a reproducingdevice may reproduce and output data recorded on the recording medium.Examples of the recording medium may include a Blue-ray disc (BD), adigital versatile disc (DVD), a compact disc (CD), etc.

A user may enjoy the data recorded on the recording medium by using thereproducing device. The user may want an additional function forconveniently using the data. For example, the user may want to rapidlyand easily search for a desired portion, and enlarge and see a portionof a screen or subtitles. Accordingly, there is a need for a techniqueto provide various types of services in a reproducing device.

SUMMARY

Exemplary embodiments address at least the above problems and/ordisadvantages and other disadvantages not described above. Also, theexemplary embodiments are not required to overcome the disadvantagesdescribed above, and an exemplary embodiment may not overcome any of theproblems described above.

The exemplary embodiments provide a recording medium, a reproducingdevice for providing various types of services by using data recorded onthe recording medium, and a method thereof.

According to an aspect of the exemplary embodiments, there is provided areproducing device including: a driver configured to load a recordingmedium in response to the recording medium being attached, wherein therecording medium records video data and additional information encodedaccording to a High Efficiency Video Coding (HEVC) method; a dataprocessor configured to process the video data; a controller configuredto provide a service corresponding to the additional information. Theservice may include at least one of a trick play service, an interestedregion enlargement service, and an object adjusting service.

The recording medium may be a blue-ray disc (BD) which is divided intofour layers including an index table, an object/BD-J object, a playlist,and a clip file. The additional information may be recorded in at leastone of a STN-table_UHD table comprised in the playlist, CPI_UHD( )recorded in the clip file, and EP_map_for_UHD_trickplay recorded in theclip file.

The controller may be configured to selectively perform the at least oneof the trick play service, the interested region enlargement service,and the object adjusting service according to a user selection.

According to another aspect of the exemplary embodiments, there isprovided a method of providing a service. The method may include:loading a recording medium in response to the recording medium beingattached, wherein the recording medium records video data and additionalinformation encoded according to an High Efficiency Video Coding (HEVC)method; providing a service corresponding to the additional information.The service may include at least one of a trick play service, aninterested region enlargement service, and an object adjusting service.

The recording medium may be a blue-ray disc (BD) which is divided intofour layers including an index table, an object/BD-J object, a playlist,and a clip file. The additional information may be recorded in at leastone of a STN-table_UHD table comprised in the playlist, CPI_UHD( )recorded in the clip file, and EP_map_for_UHD_trickplay recorded in theclip file.

The method may further include: detecting additional informationcorresponding to a selected service from the recording medium inresponse to the at least one of the trick play service, the interestedregion enlargement service, and the object adjusting service beingselected according to a user selection.

According to yet another aspect of the exemplary embodiments, there isprovided a trick play method of a reproducing device. The trick playmethod may include: loading a recording medium which stores video dataand additional information of a plurality of frames; determining whethera trick play command has been input; detecting the additionalinformation of the plurality of frames in response to determining thatthe trick play command has been input; selecting at least one layer ofthe plurality of frames based on the additional information of theplurality of frames; decoding data of the at least one layer andoutputting at least a portion of the decoded data; and performing atrick play in response to the at least a portion of the decoded databeing output.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or other aspects will be more apparent by describingcertain exemplary embodiments with reference to the accompanyingdrawings, in which:

FIG. 1 is a block diagram illustrating a structure of a reproducingdevice according to an exemplary embodiment;

FIGS. 2 through 7 are views illustrating a reproducing device forperforming a trick play service, according to various exemplaryembodiments;

FIGS. 8 through 12 are views illustrating a data structure of an opticaldisc including video data and additional information, according tovarious exemplary embodiments;

FIGS. 13 through 22 are views illustrating a reproducing device forperforming an interested region enlarging service, according to variousexemplary embodiments;

FIG. 23 is a block diagram illustrating a structure of a broadcastingreceiving device for providing an interested region enlarging serviceaccording to an exemplary embodiment;

FIG. 24 is a flowchart illustrating a method of providing an interestedregion enlarging service according to an exemplary embodiment;

FIGS. 25 through 32 are views illustrating a reproducing device forperforming an object adjusting service, according to various exemplaryembodiments;

FIGS. 33 through 35 are views illustrating a structure of data stored ona recording medium for performing an object adjusting service, accordingto various exemplary embodiments;

FIGS. 36 through 39 are flowcharts illustrating methods of providing anobject adjusting service, according to various exemplary embodiments;

FIG. 40 is a block diagram illustrating a structure of a broadcastingreceiving device for providing an object adjusting service, according toan exemplary embodiment; and

FIGS. 41 through 46 are views illustrating a method of recordingadditional information according to various exemplary embodiments.

DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS

Exemplary embodiments are described in greater detail with reference tothe accompanying drawings.

In the following description, the same drawing reference numerals areused for the same elements even in different drawings. The mattersdefined in the description, such as detailed construction and elements,are provided to assist in a comprehensive understanding of the exemplaryembodiments. Thus, it is apparent that the exemplary embodiments can becarried out without those specifically defined matters. Also, well-knownfunctions or constructions are not described in detail since they wouldobscure the exemplary embodiments with unnecessary detail.

FIG. 1 is a block diagram illustrating a structure of a reproducingdevice 100 according to an exemplary embodiment. The reproducing device100 refers to an apparatus that detects and reproduces data recorded ona recording medium 10.

The recording medium 10 may be various types of media such as a Blue-raydisc (BD), a holographic disc, a digital versatile disc (DVD), a compactdisc (CD), a universal serial bus (USB) memory stick, an external harddisc, etc. The reproducing device 100 may be realized as one independentdevice as shown in FIG. 1, but is not limited thereto. For example, thereproducing device 100 may be realized as a type that is loaded into adisplay device such as a TV, etc. In exemplary embodiments, a devicethat reproduces data from a BD and provides the reproduced data to adisplay device will be described as an example.

Referring to FIG. 1, the reproducing device 100 includes a driver 110, adata processor 120, and a controller 130.

The driver 110 is an element that, if the recording medium 10 isattached, drives the recording medium 10 to detect data. If thereproducing device 100 is realized as a device that performsreproduction with respect to an optical disc such as the BD, the driver110 may include a tray, a motor, a connector, a power connector, anoptical pickup unit, an object lens, a Digital Signal Processor (DSP), aFront End Processor (FEP), etc. The tray loads the optical disc thereon,the motor rotates the optical disc, and the connector is connected to amain board to transmit or receive various types of data. The powerconnector is supplied with power from a power supply unit, and theoptical pickup unit records a signal on the optical disc or reads areflected signal. The DSP controls an overall operation of the driver110 and operates the driver 110, and the FEP controls a laser emissionoperation of the optical pickup unit and interprets a received signal.

Video data and various types of additional information may be recordedon the recording medium 10 attached in the driver 110. If the recordingmedium 10 is attached in the driver 110, the driver 110 may detect thevideo data and the additional information. Detected data may be providedto the data processor 120 or the controller 130.

The video data may be encoded by using a High Efficiency Video Coding(HEVC) encoding method and then recorded on the recording medium 10.HEVC refers to a next generation video coding standard that has beendiscussed by Joint Collaborative Team on Video Coding (JCT-VT) that isorganized by ISO/IEC Moving Picture Experts Group (MPEG) and ITU-T VideoCoding Experts Group (VCEG). HEVC may code an image having a size of8K*4K (7680×4320) at a compression performance about 2 times higher thanexisting MPEG4-AVC.

An intra frame (I frame), a previous or predicted frame (P frame), and aBidirectional frame (B frame) are included in a video stream that iscoded by using the HEVC coding method. The I frame is a key frame thatis directly compressed and transmitted from a source. The I frame may beindependently decoded without referring to another frame. The P frame isa frame that is constituted based on information of a previous keyframe. The B frame is a frame that is constituted based on informationof the I and P frames positioned before and after B frame.

The data processor 120 processes the video data that is read by thedriver 110. The data processor 120 may include a multiplexer, a videodecoder, a scaler, an audio decoder, a filter, a signal amplifier, adata decoder, a renderer, a mixer, etc. The multiplexer detects videodata, audio data, additional data, etc. of contents recorded on therecording medium 10, and the video decoder decodes the video data. Theaudio decoder decodes the audio data, the filter filters noise, and thesignal amplifier amplifies an audio signal. The data decoder processesthe additional data, and the renderer generates an object according tothe decoded additional data. The data processor 120 may decode the videodata read from the driver 110 by using a codec corresponding to anencoding method of data recorded on the recording medium 10. Anillustration and a description of a process of processing audio data areomitted herein.

The controller 130 provides various types of services using the dataread from the driver 110. The services may include at least one of atrick play service, an interested region enlarging service, and anobject adjusting service.

The trick play service refers to a service that is to reproduce videodata at various speeds (2×, 3×, 4×, . . . ) in a forward direction or abackward direction. The interested region enlarging service refers to aservice that is to partially enlarge only a region of a frame anddiscriminately display the enlarged region. The object adjusting servicerefers to a service that is to enlarge objects, such as subtitles, amenu, etc., displayed on a screen, and discriminately display theenlarged objects.

The controller 130 may appropriately use the video data and theadditional information recorded on the recording medium 10 to providethese services. In other words, various types of additional informationare to be recorded on the recording medium 10 to support servicesdescribed above.

In this case, data is to be recorded in a format matching with astandard applied to the recording medium 10. If the video stream storedin the recording medium 10 is an HDMV HEVC video stream, the followingconstraints may be applied:

-   -   A first size per one slice is one largest coding tree block row.        The slice may be formed of one largest coding tree block row.        The largest coding tree block row may refer to a whole largest        coding tree block row in a horizontal row of a largest coding        tree block.    -   A horizontal boundary of a tile may be aligned by a horizontal        boundary of the slice.    -   The HDMV HEVC video stream may have a multiple temporal sub        layer. If trick_play_info of extended data of clip information        is set to 1,    -   vps_max_sub_layers_minus 1 may be 1 or 2, but may be 0 if not        so.    -   sps_max_sub_layers_minus 1 may be 1 or 2, but may be 0 if not        so.    -   vps_temporal_id_nesting_flag may be set to 1.    -   A temporal ID of the I frame may be equal to 0. A temporal ID of        the P frame may be equal to 0 or 1. A temporal ID of the B frame        may be greater than the temporal ID of the P frame of a Group of        Pictures (GOP). Temporal IDs of the B frame of the GOP may be        the same. A temporal ID of a reference B frame may be greater        than the temporal ID of the P frame and smaller than the        temporal ID of the B frame of the GOP. Also, temporal IDs of a        reference B frame of the GOP may be the same. If there exist        three consecutive B frames, one of the three consecutive B        frames may be a reference B frame.    -   If “is_there_interesting_region” of the extended data of the        clip information is set to 1,    -   “tiles_enabled_flag” of a PPS may be set to 1, and may be set to        0 if not so.    -   “entropy_slice_enabled_flag” of the PPS may be set to 1.    -   “dependent_slice_enable_flag” of a slice header may be set to 1.    -   “loop_filter_across_tiles_enabled_flag” of the PPS may be set to        0.    -   If a boundary of a slice is shared with a boundary of a tile,        “loop_filter_across_slices_enabled_flag” of the PPS may be set        to 0.    -   Permitted values of parameters of a VPS may be as follows:    -   If a value of “vps_max_sub_layers_minus1” is greater than 0, a        value of “vps_temporal_id_nesting_flag” may be equal to 1. In        other words, a temporal sub layer exists and may be used for a        trick play. If not used for the trick play, a value of        “vps_temporal_id_nesting_flag” may be equal to 0.    -   A value of “vps_max_sub_layers_minus1” may be 0, 1, or 2.    -   A value of “vps_num_hrd_parameters” may be set to 0.    -   Permitted values of parameters of “profile_and_level( ) referred        by the VPS and an SPS may be as follows:    -   A value of “general_profile_space” may be set to 0.    -   A value of “general_profile_idc” may be set to 1.    -   A value of “general_profile_compatible_flag[i]” may be set to 1.    -   A value of “general_level_idc” may be one of 90, 93, 120, 123,        and 150.    -   A value of “sub_layer_profile_present_flag[i]” may be set to 0.    -   A value of “sub_layer_level_present_flag[i]” may be set to 0.    -   Attributes “sub_layer_profile_space[i]”, “sub_layer_tier_flag”,        “sub_layer_profile_idc[i]”,        “sub_layer_profile_compatibility_flag[i][j]”, and        “sublayer_level_idc[i]” may be regarded as respectively having        the same values as “general_profile_space”,        “general_layer_tier_flag”, “general_layer_profile_idc”,        “general_layer_profile_compatibility_flag[i]”, and        “general_layer_level_idc”.    -   Permitted values of parameters of the SPS are as follows:    -   A value of “sps_max_sub_layers_minus1” may be one of 0, 1, and 2        and may be equal to a value of “vps_max_sublayers_minus1”.    -   If a value of “vps_temporal_id_nesting_flag” is equal to 1, a        value of “sps_temporal_id_nesting_flag” may be 1.    -   A value of “vui_parameters_present_flag” may be set to 1.    -   Permitted values of parameters of the PPS are as follows:    -   A value of “entropy_slice_enabled_flag” may not be changed.    -   If “tiles_enabled_flag” is set to 1, a value of        “entropy_slice_enabled_flag” may be ser to 1 in order to        comfortably view a UHD content on a HD display. Also,        “dependent_slice_enabled_flag” in the slice header may be set to        1.    -   If “tiles_enabled_flag” is set to 1, values of        “loop_filter_across_tiles_enabled_flag” and        “loop_filter_across_slices_enabled_flag” may be set to 0.

As described above, the controller 130 may detect video data andadditional information from the recording medium 10 that records datasatisfying the above-described various constraints, to provide variousservices. Exemplary embodiments for providing these services will now bedescribed.

As described above, various types of recording media are currently used.A reproducing device that performs reproduction with respect to such arecording medium may reproduce a normal video and provide a trick playfunction of playing a video at a fast speed in a forward or backwarddirection for user convenience.

Therefore, in the present exemplary embodiment, an accurate and detailedtrick play service may be provided using layers and additionalinformation of a frame of video data.

In other words, as described above, video data recorded on the recordingmedium 10 may be coded by using an HEVC coding method. Thus, the videodata recorded may include I, P, B, etc. frames.

The I, P, and B may be divided into a plurality of layers. The divisionof the layers may be determined according to a decoding order. In otherwords, frames that may be independently decoded or may be decoded withreference to other minimum frames may be set to lower layers, and theother frames may be set to upper layers. The division of the layers willbe described in detail later.

The additional information that may be used for a trick play may berecorded together on the recording medium 10. The additional informationmay include GOP structure information, HEVC information, offsetinformation, etc. The GOP structure refers to information about whethera Br picture exists in a GOP, the number of B pictures existing betweenthe I and P frames, a position of a Br picture among consecutive Bspictures, etc. One picture may refer to one frame or one field of a pairof complementary fields, and one frame may be the one frame, a pair ofcomplementary reference fields, or a pair of complementary non-referencefields. The I frame is formed of only I slices, the B frame and the Brframe are formed of only B slices, and the P frame is formed of only Pslices.

Also, the Br frame refers to a reference frame that may be referred toby another B frame of B frames that are decoded with reference toanother frame. For convenience, a non-reference B frame except the Brframe is referred to as a B frame.

The HEVC information may include temporal IDs, etc., of the I, P, and Bpictures. The temporal IDs may be set differently according to layers.If a temporal ID of a lowermost layer is 0, temporal IDs of upper layersmay be set in order of 1, 2, . . . , and n.

The offset information may include information about offset of animmediately following I, P, or B frame according to a decoding order,coding size information of I, P, and B frames to be read, etc.

The user may input a trick play command using a button (not shown)provided on the body of the reproducing device 100 or an additionalremote controller. The trick play command is a command to determine atwhat time speeds reproduction is to be performed with respect to arecording medium. A trick play speed may be determined by the trick playcommand. In detail, if a button matching with the trick play commandinput by the user is selected one time, the controller 130 may determinethat a 2× trick play command has been input. However, if the button isselected two times, the controller 130 may determine that a 3X trickplay command has been input. If the button is selected three times, thecontroller 130 may determine that a 4× trick play command has beeninput. In other words, the controller 130 may differently determine aspeed according to the number of times selecting the button.Alternatively, the controller 130 may differently determine the speedaccording to times when the button matching with the trick play commandis selected. In other words, as the button is pressed for a long time,the controller 130 may set the speed to be faster. Different buttons maymatch with the trick play command according to speeds, and a UI screenfor selecting speeds may be displayed to allow the user to determine aspeed on the UI screen.

If the trick play command is input, the controller 130 may perform atrick play corresponding to a trick play speed determined by the trickplay command. Further, the controller 130 selects a layer that is to bedecoded, within a video stream by using additional information. Thecontroller 130 controls the data processor 120 to decode video data ofthe selected layer. If the video data is decoded, the controller 130performs a trick play corresponding to a trick play speed selected bythe user, by using all or a portion of the decoded data. If thereproducing device 100 is realized as a Blue-ray (BD) disc reproducingdevice or a DVD reproducing device, the controller 130 selectivelyoutputs a frame corresponding to the all or the portion of the decodeddata to an external display device. The external display device receivesand displays the output frame. Therefore, the trick play may beachieved.

The reproducing device 100 described above may be realized as a displaydevice including a display unit (not shown). In this case, thecontroller 130 may directly output the selected frame through thedisplay unit to perform the trick play.

A layer structure of video data may be variously realized. For example,the video data may be divided into a first layer including I and Pframes, a second layer including a reference Br frame, and a third layerincluding other B frames except a Br frame.

The controller 130 checks a form of a GOP using GOP structureinformation included in the additional information. In other words, thecontroller 130 checks whether a Br frame exists, a position of the Br,the number of B frames existing between I and P frames, etc. Also, thecontroller 130 selects a layer that may realize a trick play performedat a determined speed. For example, if I and P frames are arranged atevery four frame intervals, and the user selects a 4× trick play, thecontroller 130 may select only a first layer. Therefore, if the I and Pframes are decoded and output, a 4× trick play may be accuratelyperformed. If the user performs a 2× trick play, the controller 130 mayselect first and second layers together. Therefore, if the I, P, and Brframes are all decoded and output, a 2× trick play may be performed.

The controller 130 variously combines a layer that is to be decoded,according to a trick play speed selected by the user and selectivelyoutput only a portion of a frame of the decoded layer to perform a trickplay at a determined speed. The controller 130 may selectively read,decode, and output only frames necessary for a trick play (fast forwardor fast reverse) using the above-described additional information. Inparticular, if reproduction is performed at 4× or more, frames that areread and decoded but are not output may exist. The controller 130 mayomit reading and decoding with reference to a temporal ID according to astructure of a video stream. Therefore, a precise trick play may beperformed by using P, B, and Br that may not be used as random accesspoints. The controller 130 may also check length information of the I,P, and B frames according to the offset information of the additionalinformation. Therefore, the controller 130 may check start positions ofthe I and P frames using the offset information and read data necessaryfor a trick play without parsing using lengths of the I and P frames inorder to perform the trick play.

FIG. 2 is a view illustrating a process of generating a video streamincluding frames, each of which is divided into three layers, accordingto an exemplary embodiment. In detail, FIG. 2 illustrates a process ofgenerating a video stream that includes 24 frames per 1 second accordingto a progressive method, and is coded and compressed by an HEVC encoder2000.

As shown in FIG. 2, video data stored on the recording medium 10 may becoded according to an HEVC standard. However, in the presentspecification, the terminology of an MPEG-2 video coding standard andthe terminology of an MPEG-4 AVC video coding standard may be used anddescribed together. For example, 24 p means that the video stream has 24frames as a progressive video, and 48i means that the video stream has48 fields as an interlace video.

FIG. 2 illustrates a process of generating a 24 p video stream that isto be decoded by an HEVC decoder having a decoded picture buffer (DPB)with a size of 3.

Referring to FIG. 2, a non-compressed video sequence 310 including aplurality of frames arrayed in a display order is encoded by the HEVCencoder 2000 to be converted into a compressed video sequence 330. InFIG. 2, a picture order count (POC) refers to an order of outputtingframes that are to be reproduced.

In FIG. 2, each of the frames is divided into three layers. In otherwords, each of the frames is divided into a first layer formed of I andP frames, a second layer formed of Br frames, and a third layer formedof B frames. In a layer FIG. 320 of the frames, arrows denotereferencing, I, P, and B respectively denote I, P, and B frames, and Bframes denote B frames that may be referred to. Also, subscripts denotedisplay orders.

This video stream may be generated by a content producing device, atransmitting device, etc. Hereinafter, a device that generates a videostream will be referred to as a stream generating device. The streamgenerating device may variously realize layers of the frames accordingto exemplary embodiments. The stream generating device may also generatea stream that satisfies the following conditions:

-   -   I and P pictures have the same display and decoding orders.    -   If a decoding order of a B picture (i.e., a non-reference B        picture) is ahead of a decoding order of another B picture, a        display order of the B picture is ahead of a display order of        the another B picture.    -   The P picture does not refer to the B picture.    -   The B picture may refer to complementary field pairs of I frames        or P frames or I and P pictures right before or after the B        picture in the display order. Also, the B picture may refer to        complementary field pairs of a Br picture or a B picture        positioned between I and P frames.    -   A Br picture (i.e., a reference B picture) may refer to        complementary field pairs of an I or P frame or I and P pictures        right before or after the Br picture. Also, a Br field may refer        to a Br field constituting complementary reference field pairs.    -   The maximum number of consecutive B frames, the maximum number        of complementary reference field pairs of a B picture, or the        maximum number of complementary non-reference field pairs of the        B picture is 3 in the display order.

The stream generating device including the HEVC encoder 2000 encodes astream according to the above-described conditions and transmits theencoded stream. If the stream is a stream of a broadcasting program thatis used in a broadcasting system, the GOP structure information and theHEVC information of the above-described additional information may beuniformly maintained with respect to the entire stream, and offsetinformation may be variably transmitted.

Therefore, if a reproducing device receiving a video stream secures GOPstructure information and HEVC information of the video stream andoffset information of an I or P frame, a trick play may be performed ina forward or backward direction.

FIG. 3 is a view illustrating a process of decoding a 24 p video streamgenerated as described in the exemplary embodiment of FIG. 2, using anHEVC decoder having a DPB with a size of 3, according to an exemplaryembodiment.

Referring to FIG. 3, a video stream 410 includes frames, each of whichis divided into three layers, and is input into the reproducing device100. A temporal ID is set with respect to each of the layers. In otherwords, a temporal ID of a first layer is set to 0, a temporal ID of asecond layer is set to 1, and a temporal ID of a third layer is set to2. The controller 130 may read and decode data of each frame accordingto decoding order.

In FIG. 3, a second stream 420 includes frames that are arrayedaccording to decoding order. An HEVC decoder 121 of the data processor120 sequentially decodes data according to the decoding order. Here,frames are sequentially buffered in a DPB 440 of an HEVC. The controller130 may control the data processor 120 to array and output the decodedframes according to a display order.

A last stream 430 of FIG. 3 is arrayed according to the display order.

If a trick play command is input, the controller 130 may read, decode,and output only an appropriate frame using additional information toperform a trick play at a speed corresponding to the trick play command.

If the stream 410 having a structure as illustrated in FIG. 3 is input,additional information may have the following values:

GOP Structure Information

Whether a Br picture exists in a GOP: YES

The number of B pictures between I or P pictures right before or afterthe B pictures: 3:

A position of a Br picture among consecutive Bs pictures: 2

HEVC Information

Temporal IDs of I and P pictures: 0, 0

Offset Information

Offset of an immediately following I, P, or B frame in a decoding order:offset 1, offset 2, offset 3

Coding size information of I, P, and B frames to be read: 1.3 Mbyte(including I and Br), 800 Kbyte (including P and Br), 800 Kbyte(including P and Br)

The controller 130 may check a structure of a GOP based on theabove-described GOP structure information, and selectively read, decode,and output a layer corresponding to a trick play speed selected by theuser based on HEVC information and the offset information

The reproducing device 100 may acquire various types of informationrelated to the trick play from the additional information. The GOP maybe generated in various structures. Therefore, various types of trickplays may be performed according to the structure of the GOP.

FIG. 4 is a table illustrating GOP information of additional informationand information acquired from the additional information, according tovarious exemplary embodiments. Referring to FIG. 4, the number ofconsecutive Bs pictures may be various set to 1, 2, or 3. Br picturesmay be included or omitted. Therefore, a value indicating whether a Brpicture exists in the GOP structure information may be recorded as “YES”or “NO’. Also, a position of the Br picture may be variously set.

The reproducing device 100 may check a supportable trick play speedbased on the GOP structure information and determine whether reorderingis to be performed during a lowest speed reproduction. The reorderingrefers to a job that is to newly determine a buffering order of a DPBsince a decoding order and a display order of a recording medium do notmatch with each other.

As shown in FIG. 4, the trick play speed may be variously realized like2×, pseudo 2×, 3×, 4×, 6×, 8×, 12×, 16×, etc. Here, the pseudo 2× is notaccurate 2× but refers to a trick play speed having a level similar to2×. In other words, if the number of consecutive B frames is 1 and 2,only I and P frames are reproduced. However, if the number ofconsecutive B frames is 3, P and Br are also reproduced. In this case,the trick play speed may be accurate 2× or pseudo 2×. The reproducingdevice 100 may determine whether reordering is needed, according towhether a B or Br frame is to be reproduced.

As described above, various types of trick plays may be supportedaccording to a structure of a GOP. The reproducing device 100 mayselectively output data about a decoded frame to perform a trick playcorresponding to a trick play speed selected by the user.

FIG. 5 is a view illustrating a method of performing a trick play basedon offset information if a 24 p video stream is input, according to anexemplary embodiment.

In FIG. 5, a first stream 610 denotes a structure of a stream accordingto an output order, and a second stream 620 denotes a structure of astream according to a decoding order.

According to the first stream 610, if a user selects a 2× reproduction,the controller 130 performs reproduction in order of I0, Br2, P4, P8,Br6. When Br2 and Br6 frames are displayed, the Br2 and Br6 frames areto be displayed prior to P4 and P8 frames. Therefore, the data processor120 performs reordering in the DPB of the HEVC decoder 121. In otherhigh-speed reproductions, all of P frames are read, decode, andselectively displayed to perform a trick play.

If a 2× trick play command is input, the reproducing device 100reproduces only an I frame (I0). Also, the reproducing device 100 readsand reorders a P frame (P4) and a B frame (Br2) one by one from aposition at a distance of offset 1, and outputs the B frames (Br2) andthe P frames (P4). The reproducing device 100 jumps a position of a nextP frame (P8) at a distance of offset 1+offset 2 to read and reproducethe P frame (P8). If a next GOP is input when reproduction is performedaccording to the above-described method, the reproducing device 100reads and reorders an I frame and a B frame, and outputs the B frame andthe I frame. The controller 130 repeatedly performs this operation untila user command to stop the trick play is input or reproduction isperformed to a last content time

In the case of 4× trick play, the reproducing device 100 reproduces onlythe I frame (I0) at first. Also, the reproducing device 100 reads andoutputs only the P frame (P4) at the position at the distance of offset1. The reproducing device 100 jumps to the next P frame (P8) at thedistance of offset 1+offset 2. If a next GOP is input when thereproduction is performed according to the above-described method, thereproducing device 100 reads and outputs an I frame. The controller 130repeatedly performs this operation when the trick play is performed

In the case of 8× trick play, the reproducing device 100 reproduces onlythe I frames at first. Also, the reproducing device 100 reads anddecodes only the P frame (P4) at the distance of offset 1, and storesthe decoded P frame (P4) in the DPB. The data processor 120 decodes andoutputs the next P frame (P8) with reference to the current P frame(P4). Since the 8× trick play is performed, the P frame (P4) is onlydecoded but is not output. As a result, the I frame and the P8 frame areoutput. Thus, 8× trick play may be achieved. The controller 130repeatedly performs this operation when the trick play is performed. Ifa next frame to be output is the I frame, the controller 130 does notneed to read the current P frame. In this case, the controller 130 skipsreading of the P frame.

A trick play may be performed at various speeds according to theabove-described method.

If a 4× or more trick play is realized by using only a P frame, and allof P frames are decoded, the 4× or more trick play becomes possible.Some of the P frames that do not need to be displayed do not need to bedecoded. Therefore, decoding of a P frame that is to be decoded may beomitted to reduce a burden of a decoder. In this case, the P frame maybe divided into first and second layers.

According to another exemplary embodiment, a plurality of frames may bedivided into a first layer including I frames and some of P frames, asecond layer including the others of the P frame, and a third layerincluding B frames.

FIG. 6 is a view illustrating a method of reproducing a video streamhaving a structure described in the above-described exemplaryembodiment, according to an exemplary embodiment. In detail, FIG. 6illustrates a process of performing a trick play with respect to a videostream formed of 24 pictures or 30 pictures per second according to aprogressive method, through an HEVC decoder having a DPB with a size of2. The reproducing device 100 may determine necessity of decoding byusing HEVC information of additional information, i.e., temporal IDs

In FIG. 6, an original frame 810 is arrayed in order of, B, P, B, P, B,P, B, P, B, P, B, P, B, P, and B. According to a layer diagram 820, aframe I0 and frames P4, P8, and P12 are classified as a first layer(whose temporal ID is 0). Frames P2, P6, and P10 are classified into asecond layer (whose temporal ID is 1), and B frames are classified intoa third layer (whose temporal ID is 2).

The stream generating device encodes the original frame 810. Frames ofan encoded stream 830 are arrayed in order of I0, P2, B1, P4, B3, P6,B5, P8, B7 . . . , etc.

If a temporal ID of a P frame that does not need to be displayed duringa speed reproduction is greater than a temporal ID of a next P frame,the reproducing device 100 may omit a decoding process. In other words,if a 4X trick play is performed based on a stream of FIG. 8, frames areto be output in order of I0, P4, P8, and P12. The reproducing device 100reads and decodes the I0 frame, and jumps to a next P fame P2 usingoffset information. Since a temporal ID of the P frame P2 is 1, and atemporal ID of the next P frame P4 is 0, the controller 130 skipsdecoding a P frame P2. FIG. 6 illustrates a section that is skipped ifthe 4× trick play is performed.

A trick play method performed with respect to the stream of FIG. 6 issimilar to that described with reference to FIG. 3. Thus, repeateddescription is omitted.

As described above, the reproducing device 100 may perform a trick playat various speeds based on various types of additional information. Theadditional information may be useful when reading a video stream storedon an optical disc on which a speed is limited.

FIG. 7 is a flowchart illustrating a trick play method of a reproducingdevice according to an exemplary embodiment. Referring to FIG. 7, inoperation S910, the reproducing device loads a recording medium thatstores video data and additional information of a plurality of framesthat are classified into layers. If a trick play command is input inoperation S920, the reproducing device detects the additionalinformation from the recording medium in operation S930.

In operation S940, the reproducing device selects a layer that is to bedecoded, based on the additional information and the trick play commandand decodes data of the selected layer. In operation S950, thereproducing device outputs at least some of the decoded data to performa trick play having a trick play speed designated by the trick playcommand.

A detailed method of performing a trick play using a layer of a framerecorded in video data or an example of additional information and theadditional information is as described above with reference to FIGS. 2through 6. Thus, repeated description is omitted.

As described above, the recording medium may be realized as varioustypes such as a BD disc, a holographic disc, a DVD, a CD, a USB memorystick, an external hard, etc.

FIG. 8 is a view illustrating a structure of data stored on a recordingmedium according to an exemplary embodiment. Referring to FIG. 8, therecording medium is divided into a plurality of areas 1010 and 1020. Anoptical disc, such as a BD disc, etc., may be divided into areasaccording to the preset number of tracks. Video data of a plurality offrames divided into layers may be recorded in the second area 1020, andadditional information may be recorded in the first area 1010.

As described above, layers of frames may be variously determinedaccording to exemplary embodiments. The layers of the frames may bedivided into three layers in the above-described exemplary embodiments,but may be divided into two layers or four or more layers.

The additional information recorded in the first area 1010 may includeGOP structure information 1011 about a structure of a video stream of aGOP, HEVC information 1012 about temporal IDs differently determinedwith respect to layers, and offset information 1013 for determining asubsequent position that is to be decoded. The trick play method usingthe additional information has been described in detail in theabove-described various exemplary embodiments. Thus, repeateddescription is omitted.

FIG. 9 is a view illustrating a structure of data stored on a recordingmedium that is realize das a BD disc, according to an exemplaryembodiment.

Referring to FIG. 9, the BD disc includes four layers such as an indextable 1110, a movie object/BD-J object 1120, a play list 1130, and aclip 1140.

The clip 1140 includes a clip AV stream file that is a video stream fileand a clip information file that is a database (DB) type attributionfile related to the clip AV stream file. The clip information filestores a time stamp of an access point (AP). A reproducing device maydetect a position of a video stream that is to be read, by using APinformation of the clip information file.

The play list 1130 is an information structure that is to inform of aplay order of bit streams used during reproduction and includes aplurality of play items. In general, the play list 1130 constitutes onecontent such as a piece of movie or drama, and a play item constitutesone chapter of the one content. The play items of the play list 1130indicate what types a video stream, an audio stream, a subtitle stream,a menu stream, etc., are. Further, the play items indicate which streamID (or a stream number) and which stream attribute the stream has. Forexample, the play items indicate a video format, a frame rate,subtitles, etc., of a video and a stream attribute such as a languagecode of an audio.

Various types of additional information stored on a recording mediumaccording to the above-described exemplary embodiments are recorded inappropriate positions of the recording medium according to theirattributes.

FIG. 10 is a view illustrating a structure of additional information ofclip information according to an exemplary embodiment. Referring to FIG.10, the clip information is divided into stream information and a randomaccess point. GOP structure information and HEVC information arerecorded in the stream information, and offset information is recordedin the random access point.

Information 1220 about the number of Br pictures and offset 1250 to animmediately following I or P frame in decoding order may be set tomandatory data that is mandatorily written, and other data 1210, 1230,and 1240 may be set to optional data that is selectively written.

Temporal ID information 1240 is used to read a frame and determine an Ior P picture that does not need to be decoded, when a high-speed trickplay is performed. Also, the coding size information 1260 of a currentpicture is used to determine how much data is to be read after a dataapproach is performed using an offset. If the coding size information1260 is used, whether reading is to be performed may be determinedwithout data parsing. Information 1210 indicting whether a Br pictureexists or Br position information 1230 may be used for an accurate speedcalculation (i.e., 2× or pseudo 2×).

A structure of a GOP may not be changed in a whole video stream. In thiscase, as shown in FIG. 10, the GOP structure information may bedisplayed as a portion of stream information that displays informationabout a video stream.

Also, the offset information is information about I and P pictures of astream, such as the random access point information. Thus, the offsetinformation may be displayed as a portion of the random access pointinformation. Offsets of the I and P frames are recorded in FIG. 10, butthe offset of only the P frame may be displayed.

FIG. 11 is a view illustrating a structure of offset informationaccording to another exemplary embodiment. Referring to FIG. 11, GOPstructure information and HEVC information are recorded in streaminformation, and offset information is recorded in a random accesspoint. The random access point is divided into a random access point1310 of an I picture and a random access point 1320 of a P frame.Various types of offset information 1330 is recorded in the randomaccess point 1320 of the P frame.

If the structure of the offset information as illustrated in FIG. 11 isused, the I frame may be expressed using existing random access pointinformation. Therefore, a capacity used for storing additionalinformation may be reduced.

As described above, the offset information may be displayed as a portionof random access point information in clip information but may beinserted into a stream. In other words, if the offset information isinserted as SEI information before a GOP starts, a reproducing devicemay read and play the offset information when performing a trick play.

In the above-described exemplary embodiment, a method of recordingadditional information if a structure of a GOP is not changed in a wholevideo stream has been described. In this case, various types ofadditional information may be included in a random access point.

FIG. 12 is a view illustrating a data structure if various types ofadditional information are included in a random access point, accordingto an exemplary embodiment Referring to FIG. 12, the random access pointis divided into a random access point of an I picture and a randomaccess point of a P picture. The random access point of the P frameincludes GOP structure information 1410, HEVC information 1420, andoffset information 1430 per GOP.

A unit for displaying offset and coding size information may be a byte,a source packet number (SPN), a sector, etc. Alternatively, the unit maybe 3 sectors that is the least common multiple (LCM) the SPN and thesector. A unit and an amount of the offset information may be determinedaccording to various criterions such as a type, a size, etc., ofcontent.

As described above, the additional information may be stored on arecording medium according to various methods. The reproducing devicemay perform a trick play as described above using the additionalinformation. The reproducing device may perform an interested regionenlargement service besides the trick play.

FIG. 13 is a block diagram illustrating a structure of a reproducingdevice 100 that provides an interested region enlargement service,according to another exemplary embodiment.

Referring to FIG. 13, the reproducing device 100 includes a driver 110,a data processor 120, a controller 130, an interface unit 140, and astorage unit 150.

If a recording medium is attached, the driver 110 drives the recordingmedium to detect data. As described above, the recording medium may bevarious types of media such as an optical disc such as a BD, aholographic disc, or the like, a USB memory stick, an external hard,etc. A high-resolution content may be recorded on the recording medium.If the recording medium on which the high-resolution content is recordedis attached, the driver 110 detects the high-resolution content from therecording medium. The high-resolution content refers to a content havinga relatively higher resolution than an output resolution of a displaydevice. For example, the high-resolution content may refer to ultra highdefinition (UHD) content. Hereinafter, the reproducing device 100 willbe described as a device that may perform reproduction with respect to aBD 10 on which the UHD content is recorded.

The data processor 120 processes the high-resolution content detected bythe driver 110 to generate a video frame.

The interface unit 140 transmits the video frame, an audio signal, etc.generated by the data processor 120 to a display device. In detail, theinterface unit 140 may be realized as a high definition multimediainterface (HDMI).

The storage unit 150 stores an operation system (O/S) necessary for anoperation of the reproducing device 100, various types of programs ordata, etc. The controller 130 may store various types of data, which arereceived from the display device through the interface unit 140, orvarious types of information and data detected from the BD 10 in thestorage unit 150.

If a recording medium such as a disc is attached in the driver 110, thecontroller 130 controls the driver 110 and the data processor 120 toprocess the high-resolution content. The controller 130 determines acharacteristic of the display device connected to the interface unit140, using display characteristic information stored in the storage unit150.

The display characteristic information may be acquired and stored in thestorage unit 150 according to various exemplary embodiments. Forexample, the controller 130 may receive the display characteristicinformation from the display device through the interface unit 140. Thedisplay characteristic information may include various types ofinformation such as an output resolution of a display panel of thedisplay device, a pixel count, a display size, a viewing distance, adevice model name, etc. If the interface unit 140 is realized as theHDMI as described above, the controller 130 may acquire extended displayidentification data (EDID). The controller 130 may estimate whether thecurrently connected display device is a low-resolution display device,using a maximum horizontal image size, a maximum vertical image size, anestablished timing bitmap, etc., of the EDID. The display characteristicinformation may be referred to as various names such as viewingenvironment information, resolution information, the EDID, etc., butwill be commonly referred to the display characteristic information.

As another example, the display characteristic information may bedirectly input by a user. Further, the reproducing device 100 maydisplay a user interface (UI) for determining an output resolutionthrough a touch screen panel of the reproducing device 100, an externaldisplay device, etc. The user may input an output resolution such as,UHD, HD, etc., through the UI. The controller 130 stores the displaycharacteristic information such as the input output resolution in thestorage unit 150. If the display device and the reproducing device 100are connected to each other using a method such as a HDMI, thecontroller 130 may automatically acquire display characteristicinformation, such as screen size information, and store the displaycharacteristic information as viewing environment information in thereproducing device 100. If analog connection method is used or thedisplay characteristic information may not be acquired due to otherreasons, the viewing environment information may be generated as a valueset in the manufacturer or a value set by the user and stored in thestorage unit 150.

As described above, the viewing environment information of thehigh-resolution content may be stored in the storage unit 150. Thecontroller 130 determines a characteristic of the display deviceconnected to the interface unit 140, using information stored in thestorage unit 150.

If it is determined that the display device is a low-resolution displaydevice, the controller 130 controls the data processor 120 to replace atleast a portion of video frames of the high-resolution content with aninterested region image. A low resolution refers to a relatively lowerresolution than a resolution of a content. For example, if the contentis a UHD content having a resolution between 4000 (3840×2160) and 8000(7680×4320), an output resolution of an HD display device having aresolution of 1920×1080 corresponds to a low resolution. Hereinafter,the high-resolution content will be described as a UHD content, and alow-resolution display panel or device will be described as a displaypanel or device having an HD resolution. However, the exemplaryembodiments are not limited thereto. Thus, if a resolution of a contentis higher than a resolution of the display panel or device, the presentexemplary embodiment may be applied as is.

The interested region image refers to an image of a local region of onevideo frame. In other words, a video frame of a UHD content may begenerated to be displayed on a UHD display device 4 times larger than anHD display device. Therefore, detailed image regions of a whole imageare formed in sizes that may be identified at a viewing distance of auser based on a UHD viewing environment. However, the detailed imageregions are scaled down by 1/4 times to be displayed on the HD displaydevice. Therefore, sizes of the detailed image regions are extremelyreduced. Thus, it is difficult for the user to identify the detailedimage regions at the same viewing distance. Although the user is able toidentify the detailed image regions, it is difficult to convey feelingintended by a maker. For example, even if the display device displaysthe detailed image regions, and talking of characters is a main content,the characters occupy only a small portion, not a whole screen,according to a related art. In this case, the user may not identifyexpressions or eyes of the characters who talk with one another.Therefore, it is difficult for the user to recognize the feeling thatthe maker wants to convey.

Therefore, a content maker may select a portion of detailed imageregions of video frames to which the user is to pay attention, as aninterested region. The content maker may provide interested regioninformation indicating the interested region to the reproducing device100.

The controller 130 may control the data processor 120 to check aninterested region of a video frame of a high-resolution content based onthe interested region information, generate the interested region in aframe size, and replace the video frame with the interested region.According to exemplary embodiments, the interested region informationmay be recorded on the BD 10, may be provided through an external serverdevice, or may be provided according to various methods.

Detailed descriptions and illustrations of the same elements of thereproducing device 100 of FIG. 13 as those of the reproducing device 100of FIG. 1 are omitted.

Cropping information may be provided along with the interested regioninformation. The cropping information refers to information that definesa portion to be deleted in consideration of a size constraint of alargest coding unit (LCU). In other words, if an interested region isdefined in each LCU within an image frame, an image having a size of1920×1088 may be extracted from a UHD image. Cropping is required todisplay the image on a display device having a size of 1920×1080.Therefore, if cropping information that has determined a position to becropped is provided, an image having an appropriate HD size may beoutput through the display device. The cropping information may also beprovided through a recording medium such as the disc 10 or through anexternal server device.

According to an exemplary embodiment, one of video frames of ahigh-resolution content including an interested region may be dividedinto a plurality of tiles. Sizes, position, and shapes of the tiles maybe adaptively selected according to a size of the interested region.

A title refers a coding unit in a UHD video encoder.

FIG. 14 is a view illustrating slices and titles of a coding unit in aUHD video encoder, according to an exemplary embodiment. Slices andtiles as illustrated in FIG. 14 are defined in HEVC that is a nextgeneration video coding standard that has been discussed by JCT-VC thatis organized by ISO/IEC MPEG and ITU-T VCEG.

Referring to FIG. 14, one picture, i.e., one video frame, includesslices each including the fixed number of coding tree blocks havingconsecutive raster scan orders and tiles including the fixed number ofcoding tree blocks and having square shapes. Coding tree blocksconstituting one slice may belong to several other tiles. A plurality oftiles constituting one picture may be independently decoded by aplurality of decoders in a condition in which a filter improving imagequalities of tile boundaries is not used.

As described above, one video frame may be divided into a plurality oftiles, and tile data of each of the tiles may be independently decoded.

Therefore, if interested region information that has designated tiledata corresponding to an interested region is provided, the controller130 may control the data processor 120 to selectively decode tile datacorresponding to the interested region among a plurality of pieces oftile data according to the interested region information and generate animage of the decoded tile data in a frame size.

FIG. 15 is a view illustrating an interested region that is expressed asa tile, according to an exemplary embodiment. As shown in FIG. 15, onevideo frame may be divided into a plurality of tiles. The tiles havecoding tree blocks as basic unit and have rectangular shapes. Therefore,if a center of a screen is an interested region, one screen is dividedinto 9 titles.

Referring to FIG. 15, a whole region of a video frame 60 is divided intonine tiles TileID 0 through TileID 8. If the fifth tile of the ninetiles, i.e., TileID 4, is designated as an interested region, interestedregion information may include an TileID 4 that is an identifier fordesignating the corresponding tile. The controller 130 controls the dataprocessor 120 to enlarge an image of a tile corresponding to TileID 4 ina whole frame size to replace the video frame 60 with the image of theenlarged portion TileID 4.

FIGS. 16A through 16C are views illustrating an operation of areproducing device that provides an interested region enlargementservice, according to an exemplary embodiment.

Referring to FIGS. 16A through 16C, interested region information may bestored along with a high-resolution content on a disc, i.e., a recordingmedium. According to an exemplary embodiment, the disc may store thehigh-resolution content, type information indicating a type of thehigh-resolution content, the interested region information, notificationinformation for notifying whether interested region information exists,a video output mode information for permitting whether a video frame isto be changed by using the interested region, etc. The disc may furtherstore subtitles to be added to the high-resolution content or varioustypes of information about menus.

The high-resolution content refers to a content such as a UHD imagedescribed above. Video data of the high-resolution content may include aplurality of pieces of tile data.

As described above, the reproducing device 100 requires displaycharacteristic information to check whether a screen for displaying acontent is a high-resolution screen or an HD screen. The displaycharacteristic information may be regarded as information necessary forselecting and outputting an object appropriate for the screen, but thetype information may be information that may be selectively recorded.

The interested region information is information that is to define aninterested region of each video fame. According to exemplaryembodiments, the interested region information may have various values.If a video frame is divided into a plurality of tiles, and thus aplurality of pieces of tile data are included in video data as in thepresent exemplary embodiment, the interested region information may beinformation that designates at least one of the tile data. According toan H.264 standard, the interested region information may be recorded assupplemental enhancement information (SEI) or additional navigationinformation.

The video output mode information is information that is to determinewhether an original picture is to be replaced or is to be output as itis by using an image of the interested region. The video output modeinformation may include a first value corresponding to “Yes” or a secondvalue corresponding to “No”. The video output mode information may bedetermined by an intention of a content maker. In other words, a makermay not want to determine and process a difference between a content anda viewing environment. An element for controlling not to arbitrarilychange a vide frame is to be provided to the maker in consideration ofthis, and the video output mode information operates as the element.

As described above, various types of information may be stored on thedisc 10. If the disc 10 is attached, the controller 130 checks a viewingenvironment of a display device connected to the reproducing device 100using the display characteristic information stored in the storage unit150.

FIG. 16A illustrates a UHD display device 200 that is connected to thereproducing device 100. In this case, the controller 130 decodes videodata of a high-resolution content as it is to provide an original videoframe. Therefore, the UHD display device 200 displays original videoframes of the high-resolution content as they are.

FIGS. 16B and 16C illustrating an HD display device 300 that isconnected to the reproducing device 100. If it is determined that the HDdisplay device 300 has been connected, the controller 130 scales down avideo frame of the high-resolution content in a display size of the HDdisplay device 300. The controller 130 checks video output modeinformation.

If it is checked that the video output mode information has a value“No”, the controller 130 scales down the video frame of thehigh-resolution content according to the display size of the HD displaydevice 300. Therefore, as shown in FIG. 16B, an original video frame isscaled down and displayed.

If it is checked that the video output mode information has a value“Yes”, the controller 130 checks the above-described notificationinformation of the information detected by the driver 110. Therefore,the controller 130 determines whether interested region information isincluded. If the interested region information is not included, thecontroller 130 processes video data of the high-resolution content togenerate a plurality of video frames as they are and provides theplurality of video frames to the display device through the interfaceunit 140. If the interested region information is included, thecontroller 130 controls the data processor 120 to selectively processtile data designated by the interested region information to generatethe title data in a video frame size. Therefore, as shown in FIG. 16C,the HD display device 300 displays an image corresponding to TileID 4 ina frame size.

If processing is performed as described above, a user may view animportant portion of the high-resolution content in an identifiable sizeeven in a viewing environment in which the video frames of thehigh-resolution are scaled down and displayed in display sizes.

In the above-described exemplary embodiment, the type information isoption information that may be selectively written. Thus, a contentmaker may not record type information of a content. If the content makerdoes not record the type information of the content, the controller 130may check a type of the content based on information reflecting acharacteristic of the display device and perform the above-describedoperation.

FIG. 17 is a view illustrating an operation of the reproducing device100 of the above-described exemplary embodiment. Referring to FIG. 17,the data processor 120 of the reproducing device 100 includes a videodecoder 121 and a scaler 122.

The video decoder 121 decodes video data of a high-resolution contentstored on the disc 100.

If the disc 10 is attached, the controller 130 drives the driver 110 todetect various types of data stored on the disc 10. The controller 130compares information about a viewing environment of the HD displaydevice 300 with type information stored on the disc 10, wherein theinformation about the viewing environment is stored in the storage unit150. If the high-resolution content is stored on the disc 10 or theviewing environment is a low resolution according to the comparisonresult, the controller 130 controls an operation of the video decoder121 based on interested region information and video output modeinformation stored on the disc 10.

As in the above-described exemplary embodiment, a video frame includingan interested region may be divided into a plurality of tiles. In thiscase, a bitstream of the video frame may be divided into a plurality ofpieces of tile data.

If the video output mode information has a value “Yes”, the controller130 controls the video decoder 121 to selectively decode only tile datadesignated by the interested region information. If the video frame doesnot include the interested region or the video output mode informationhas a value “No”, the controller 130 controls the video decoder 121 todecode all of data of the corresponding video frame.

The scaler 122 forms a video frame using the data decoded by the videodata. As a result, a video frame including the interested region isreplaced with an interested region image that is generated in a framesize, and a video frame not including the interested region is scaleddown in a display size of the HD display device 300. The video frame,scaled by the scaler 122, is transmitted to the HD display device 300.Although not shown in FIG. 17, if graphic objects such as subtitles ormenus exist, a mixer that mixes the graphic objects with a video framemay be further included in the data processor 120.

If a portion that a content maker wants to highlight, i.e., aninterested region, exists in a particular video frame, the content makermay divide the corresponding video frame into a plurality of tilesaccording to a position, a size, and a shape of the interested region.For example, as shown in FIG. 15, if the interested region is positionedin a central region of the video frame, the video frame may be dividedinto nine tiles.

FIG. 18 is a view illustrating a bitstream for expressing a pictureformed of one slice and nine tiles. The content maker divides a videoframe including an interested region, i.e., a picture, into a pluralityof pieces of tile data and encodes the plurality of pieces of tile data.An HEVC encoder may be used to perform encoding. A grammar of HEVCexpresses coding tree blocks of the slice as a raster scan order. Thus,the bitstream is formed in an order as illustrated in FIG. 18. In otherwords, 0th through eighth tile data are sequentially arranged in anorder from a head part that is first input to a tail part that is lastlyinput. In FIG. 18, each of TileID 0, 2, 6, and 8 includes two codingtree blocks, each of TileID 3 and 5 includes four coding tree blocks,each of TileID 1 and 7 includes three coding tree blocks, and TileID 4includes six coding tree blocks.

If TileID 4 is designated by interested region information, the videodecoder 121 selectively detects and decodes the corresponding tile dataTileID 4, and does not decode the other tile data. The scaler 122 scalesthe decoded tile data to generate an image having a frame size.

As described above, a reproducing device may decode and process only aportion of a particular video frame. In this case, a process of dividinga video frame into a plurality of pieces of tile data and encoding theplurality of pieces of tile data is required.

According to another exemplary embodiment, a reproducing device mayextract and display an interested region from data that is not dividedin an encoding process.

FIG. 19 is a view illustrating an operation of a reproducing device thatprovides an interested region enlargement service, according to anotherexemplary embodiment. In the present exemplary embodiment, a recordingmedium, i.e., the disc 10, may store a high-resolution content that isnot divided into tiles or includes one video frame having one tile, typeinformation, notification information indicating whether an interestedregion exists, interested region information, video output modeinformation, etc. The interested region information includes informationthat is to designate a position of the interested region within a videoframe of the high-resolution content. For example, if the interestedregion is designated in a rectangular shape, the interested regioninformation may include information about a pixel coordinate value, awidth, and a height of one of four corners of the rectangular shape.

If the disc 10 is attached, the controller 130 controls the dataprocessor 120 to detect and decode corresponding video data to generatea video frame and crop a region defined by the interested regioninformation from the video frame to enlarge the region in a video framesize.

For example, if a left upper corner is set to a reference point, and acoordinate value of the reference point is (x, y), a width of thereference point is w, and a height of the reference point is h, thecontroller 130 recognizes a rectangle having pixel coordinates (x, y),(x+w, y), (x, y+h), (x+w, y+h) as corners, as an interested region. Thecontroller 130 controls the scaler 122 to generate a video frameaccording to the video data decoded by the video decoder 121, and cropsand scales an image of a portion recognized as an interested region.Therefore, the HD display device 300 displays an original video frameand a cropped image, i.e., an interested region image.

Referring to FIG. 19, an image 810 of a region of a video frame 800 isenlarged and output in a frame size

In the above-described exemplary embodiments, interested regioninformation is stored on a recording medium to be provided to thereproducing device 100. However, the interested region information maybe provided according to other methods. In other words, the interestedregion information may be provided through an additional server device.

FIG. 20 is a block diagram illustrating a structure of the reproducingdevice 100 that provides an interested region enlargement service,according to another exemplary embodiment. Referring to FIG. 20, thereproducing device 100 includes the driver 110, the data processor 120,the controller 130, the interface unit 140, the storage unit 150, and acommunicator 160.

According to the present exemplary embodiment, a recording medium, i.e.,the disc 10, may store address information about a server device thatmay provide interested region information.

The address information refers to address information about a serverdevice that provides a low-resolution object. The address informationrefer to information, such as a uniform/universal resource locator(URL), an IP address, a server name, etc., of the server device, thatmay be stored in an identifier form or a JAVA program form. In general,a time when releasing a movie using a recording medium having an opticaldisc type may be a time that does not become 1 month after the movie isshown in a theater. It may be difficult to determine an interestedregion within such a short time, and although the interested region isdetermined within the short time, the interested region may be added orchanged later. Therefore, the server device may be used after an opticaldisc is released, to provide interested region information.

If the address information is detected by the driver 110, the controller130 controls the communicator 160 to access the server device using thedetected address information.

The communicator 160 communicates with an external server device usingthe address information stored on the disc 10. The communicator 160 mayaccess the external server device using WiFi, IEEE, Bluetooth, a localarea network (LAN), etc. The external server device may be a serverdevice that is operated by a content maker, a reproducing devicemanufacturer, a display device manufacturer, etc. The controller 130receives interested region information of the external server devicethrough the communicator 160 and stores the interested regioninformation in the storage unit 150. As described in the exemplaryembodiment of FIG. 19, the interested region information may includeinformation about a reference coordinate value, a width, a height, etc.,for designating an interested region.

The controller 130 controls the data processor 120 to crop an interestedregion image from a video frame to enlarge the interested region imagein a frame size using the interested region information stored in thestorage unit 150. The video frame generated by the data processor 120 isprovided to an external display device through the interface unit 140 tobe displayed.

FIGS. 21A through 21C are views illustrating an operation of thereproducing device 100 of FIG. 20, according to an exemplary embodiment.As shown in FIG. 21A, if a UHD display device 200 is connected, thereproducing device 100 decodes UHD image data as it is to provide avideo frame. Therefore, the UHD display device 200 displays an originalvideo frame as it is.

As shown in FIGS. 21B and 21C, if an HD display device 300 is connected,the reproducing device 100 may determine whether to perform croppingaccording to video output mode information. FIG. 21B illustrates thevideo output mode information that has a value “No”. Referring to FIG.21B, although the HD display device 300 is connected, the reproducingdevice 100 provides an original video frame as it is.

FIG. 21C illustrates the video output mode information that has a value“Yes”. Referring to FIG. 21C, the reproducing device 100 accesses aserver device 1000 to receive interested region information. Thereproducing device 100 crops and outputs a region according to thereceived interested region information.

FIG. 22 is a view illustrating an internal structure and an operation ofthe reproducing device 100 of FIG. 21, according to an exemplaryembodiment. Referring to FIG. 22, the communicator 160 of thereproducing device 100 receives the interested region information fromthe server device 1000 using a position of the interested regioninformation stored on the disc 10, i.e., address information. Thereceived interested region information is provided to the video decoder121. The video decoder 121 crops an interested region image of a videoframe including an interested region based on the interested regioninformation. The cropped interested region image is enlarged in a framesize, and then provided to the HD display device 300.

In the above-described exemplary embodiments, a reproducing device thatdirectly performs reproduction with respect to a recording medium hasbeen illustrated and described. However, the reproducing device may berealized as various types of content processing devices such as a signalreceiving device (for example, a set-top box) or a TV (i.e., displaydevice) that receives and processes a signal including a high-resolutioncontent through a broadcasting network or other communication networks,etc.

FIG. 23 is a block diagram illustrating a content processing device thatis realized as a broadcasting receiving device, according to anexemplary embodiment. Referring to FIG. 23, the content processingdevice 100 includes a receiver 170, a data processor 120, a display unit180, a controller 130 and a storage unit 150. The same elements of thepresent exemplary embodiment as those of the previous exemplaryembodiments are denoted by the same reference numerals. Thus, theirrepeated descriptions are omitted.

The receiver 170 may have different structures according to broadcastingcommunication standards that are used in nations using the contentprocessing device. There are currently various types of digitalbroadcasting standards such as Advanced Television System Committee(ATSC), Digital Video Broadcasting (DVB), Integrated Services DigitalBroadcasting-Terrestrial (ISDB)-T, etc. For example, if the ATSCstandard is used, the receiver 170 may include an antenna, a radiofrequency (RF) down-converter, a demodulator, an equalizer, etc.

The receiver 170 receives a signal including a high-resolution contentthrough a broadcasting network and transmits the high-resolution contentto the data processor 120.

The data processor 120 may include a demultiplexer, an RS decoder, adeinterleaver, etc. Detailed structures for transmitting and receivingsignals according to respective broadcasting standards are disclosed indetail in standard documents of the respective broadcasting standards.Thus, their detailed illustrations and descriptions are omitted.

The display 180 includes a display panel. A characteristic of thedisplay panel is stored in the storage unit 150. Therefore, in thepresent exemplary embodiment, the controller 130 may immediately checkthe characteristic of the display panel using information recorded inthe storage unit 150 without a need to check the characteristic of thedisplay panel installed in an external device, i.e., a viewingenvironment.

If the display panel is used for a low resolution, and it is determinedthat the high-resolution content has been received through the receiver170, the controller 130 controls the data processor 120 to performoperations according to the above-described exemplary embodiments.Therefore, a video frame of the high-resolution content is scaled downin a display size to be displayed, and a video frame including aninterested region is replaced with an image of the interested region tobe displayed.

The display unit 180 displays a video frame, to which a low-resolutionobject is added, through the display panel. The display unit 180 mayfurther include a backlight unit or other driving circuits besides thedisplay panel. However, the detailed illustration and description areomitted.

If a high-resolution content is provided through a broadcasting networkas shown in FIG. 23, various types of additional information, such asinterested region information, notification information, video outputmode information, etc., may be recorded in various fields of abroadcasting signal and then transmitted. For example, the various typesof additional information may be provided through a terrestrial virtualchannel table (TVCT), an event information table (EIT), a program maptable (PMT), a metadata stream, or the like.

FIG. 24 is a flowchart illustrating a method of processing a contentaccording to an exemplary embodiment. Referring to FIG. 24, in operationS1310, a recording medium is attached. In operation S1320, video data ofa high-resolution content recorded on the recording medium is detected.

A reproducing device checks a viewing environment of the high-resolutioncontent. If it is determined in operation S1330 that the viewingenvironment is a low-resolution viewing environment, the reproducingchecks interested region information in operation S1340. In operationS1350, the reproducing device replaces a video frame including aninterested region with an image of the interested region. Forconvenience, an operation of generating a video frame may be referred toa data processing operation.

If a bitstream of video data is divided into a plurality of pieces oftile data as in the above-described exemplary embodiment, the interestedregion information may include identification information of a tilecorresponding to the interested region. In this case, the dataprocessing operation may include: selectively decoding only thecorresponding title data, and generating and scaling an image of thedecoded data in a frame size.

Alternatively, the interested region information may be information thatdirectly designates a coordinate of a region. In this case, the dataprocessing operation may include: decoding all of data of all videoframes, cropping a designated coordinate region, and acquiring aninterested region image. The interested region information may berecorded on the recording medium, or may be input from an externalserver device, etc.

Therefore, in operation S1360, at least a portion of the video frametransmitted to a display device may be replaced with the interestedregion image and then transmitted.

In operation S1370, if the viewing environment is not the low-resolutionviewing environment, the video data of the high-resolution content isprocessed as it is to generate a video frame. The generated video frameis transmitted to the display device in operation S1360.

A method performed by the reproducing device has been described in FIG.24, but the reproducing device may be realized as a broadcastingreceiving device such as a TV described above.

In the above-described exemplary embodiments, a disc is used as anexample of a recording medium. In detail, a high-capacity recordingmedium that may store a UHD content like a BD, a holographic disc, etc.,may be used. According to exemplary embodiments, various types ofinformation may be recorded on the recording medium as described above.

A storage of the recording medium may be divided into a plurality ofstorage areas according to types of recorded information. For example,the recording medium may include first, second, third, fourth, and fifthstorage areas. A high-resolution content is stored in the first storagearea, and type information indicating a type of the high-resolutioncontent is stored in the second storage area. Interested regioninformation indicating an interested region included in a video frame ofthe high-resolution content is stored in the third storage area, andinformation indicating whether the interested region information existsis stored in the fourth storage area. Video output mode information forallowing whether to change a video frame using an interested region isstored in the fifth storage area.

If the interested region information is provided to an external serverdevice as described, a seventh storage area in which address informationof the external server device is recorded may be included instead of thefourth and fifth storage areas.

The reproducing device may provide an object adjusting service. Anobject adjusting service according to an exemplary embodiment will nowbe described.

FIG. 25 is a block diagram illustrating a structure of a reproducingdevice that is realized as a reproducing device performing reproductionwith respect to a recording medium and provides an object adjustingservice, according to an exemplary embodiment. Referring to FIG. 25, thereproducing device includes an input unit 105, a data processor 120, acontroller 130, a driver 110, an interface unit 140, and a storage unit150.

The input unit 105 receives a high-resolution content. The input unit105 may be realized as a type that receives a high-resolution contentprocessed by the driver 110 or a type that receives a high-resolutioncontent transmitted from an external broadcasting station or an externalserver device.

The data processor 120 processes the high-resolution content inputthrough the input unit 105 to generate a video frame.

If a recording medium is installed, the driver 110 drives the recordingmedium to detect data.

If it is checked that the recording medium recording the high-resolutioncontent has been attached in the driver 110, the controller 130 controlsthe driver 110 to detect the high-resolution content from the recordingmedium.

The high-resolution content detected by the driver 110 is input into theinput unit 105, and the input unit 105 provides the high-resolutioncontent to the data processor 120. As described above, the dataprocessor 120 generates a video frame of the high-resolution contentunder control of the controller 130, forms a low-resolution object, andadds the low-resolution object to the video frame. A BD may store imagedata that is compressed by a codec complying with MPEG-2, H.264/MPEG-4AVC, or VC-1 standard. The data processor 120 may decode image data byusing the codec to generate a video frame.

The controller 130 controls the input unit 105 and the data processor120 to process the high-resolution content. In detail, the controller130 checks an output resolution f a display panel that is to display thevideo frame. If the reproducing device is realized as a reproducingdevice that performs reproduction with respect to a recording medium,the controller 130 checks an output resolution of a display panel of anexternal display device to which the reproducing device is connected.

If the reproducing device is realized as a display device including adisplay panel, the controller 130 checks the output resolution based oncharacteristic information of the display panel.

If the output resolution of the display panel is a low resolution, thecontroller 130 controls the data processor 120 to scale down the videoframe of the high-resolution content, form an object such as subtitlesto be added to the video frame, menus, etc., as a low-resolution object,and add the object to the video frame. As the low-resolution object isprovided, the subtitles may be displayed in sizes identifiable by auser.

A low resolution refers to a relative lower resolution than a resolutionof a content. For example, if the content is a UHD content having aresolution between 4000 (3840×2160) and 8000 (7680×4320), an outputresolution of an HD display device having a resolution of 1920×1080corresponds to a low resolution. Hereinafter, a high-resolution contentwill be described as a UHD content, and a low-resolution display panelor device will be described as a display panel or device having an HDresolution. However, the exemplary embodiments are not limited thereto.If a resolution of a content is higher than a display panel or device,the present exemplary embodiment may be applied as is.

The video frame to which the low-resolution object has been added by thedata processor 120 is provided to the display panel through theinterface unit 150 to be displayed.

The interface unit 150 is connected to the display device including thedisplay panel. In detail, the interface unit 150 may be realized as anHDMI.

Therefore, although the high-resolution content is displayed through adisplay panel having a relatively low resolution, sizes of subtitles ormenus may be prevented from being reduced in proportion to theresolution of the display panel. Therefore, the user may easily identifythe subtitles or menus.

The storage unit 150 stores an O/S or various types of programs or datanecessary for an operation of the reproducing device. The storage unit10 may also store information such as the output resolution of thedisplay device to which the reproducing device is connected. The outputresolution information may be received from the HD display device 300and stored in the storage unit 150. In other words, the controller 130may store various types of data, which are received from the displaydevice through the interface unit 140, in the storage unit 150.

The controller 130 may receive display characteristic information fromthe display device through the interface unit 150. As described above inthe above-described exemplary embodiment, the display characteristicinformation may include various types of information such as an outputresolution, a pixel count, a display size, a viewing distance, a devicemodel name, etc., of the display panel of the display device. Thedisplay characteristic information has been described in detail in theabove-described exemplary embodiment. Thus, repeated description isomitted.

The controller 130 stores and uses the display characteristicinformation in the storage unit 150. If the display device and thereproducing device are connected to each other according to a methodsuch as an HDMI, display characteristic information, such as screen sizeinformation, may be automatically acquired and stored as viewingenvironment information in the reproducing device. If an analogconnection method is used or the display characteristic information isnot acquired due to other reasons, the viewing environment informationmay be generated as a value set in the manufacture of the reproducingdevice or a value set by the user and stored in the storage unit 150.

The controller 130 may check the output resolution of the display panelon which the video frame of the high-resolution content is to bedisplayed, using the display characteristic information stored in thestorage unit 150. According to another exemplary embodiment, thereproducing device may provide a UI through which the output resolutionmay be determined. The UI may be displayed through a touch screen panelof the reproducing device, the display device, etc. The outputresolution input through the UI by the user is stored in the storageunit 150.

A method of generating a low-resolution object may be variously realizedaccording to exemplary embodiments. For example, a low-resolution objectmay be stored separately from a high-resolution object in a recordingmedium or may be provided from a source device or a medium differentfrom the recording medium. Alternatively, the high-resolution object maybe converted into a low-resolution object, and then the low-resolutionobject may be used. A structure and an operation of the data processor120 may be changed according to exemplary embodiments. A method ofgenerating a low-resolution object according to various exemplaryembodiments will now be described in detail.

FIGS. 26A and 26B are views illustrating an operation of a reproducingdevice 100 that provides an object adjusting service, according to anexemplary embodiment.

Referring to FIGS. 26A and 26B, a UHD image, UHD subtitles, and HDsubtitles are stored in a disc 10. The UHD image may refer to ahigh-resolution content, the UHD subtitles may refer to ahigh-resolution object, and the HD subtitles may refer to alow-resolution object. As described above, an object may include varioustypes of graphic menus besides subtitles. However, for convenience ofdescription, a process of processing subtitles will be mainly described.

If the disc 10 is attached in the reproducing device 100, thereproducing device 100 checks display characteristic information of adisplay device that is connected to the reproducing device 100. FIG. 26Aillustrates a UHD display device 200 that is connected to thereproducing device 100, and FIG. 26B illustrates an HD display device300 that is connected to the reproducing device 100.

If the UHD display device 200 is connected as shown in FIG. 26A, thecontroller 130 of the reproducing device 100 adds UHD subtitles 220 toan image frame 210 having a UHD resolution, and provides the image frame210 to which the UHD subtitles 220 have been added. Therefore, a usermay view a high-resolution content through a wide screen (of about 110inches) of the UHD display device 200

The UHD image 210 is formed to be appropriate for a screen size of theUHD display device 200. However, even when a viewer views the UHD image210 through the UHD display device 200, the viewer may view the UHDimage 210 through the UHD display device 200 at the same distance fromthat at which the viewer views the UHD image 210 through the HD displaydevice 300. Since the screen size is increased at the same viewingdistance, a user who views the UHD image 210 through the UHD displaydevice 200 may secure a wide viewing angle (about 55°). If the UHDdisplay device 200 has the same viewing distance as the HD displaydevice 300, subtitles or menus may not be increased to four times (eventhough a screen is increased). In other words, the subtitles 220 may beformed in sizes that may be conveniently viewed by the viewer at thesame viewing distance as that of the HD display device 300.

Therefore, according to a related art, if a UHD image and UHD subtitlesor menus are output from the UHD display device 200, the UHD subtitlesor menus are reduced to about 1/4. Thus, in the related art, the viewermay not conveniently read the UHD subtitles or menus. However, ifsubtitles or menus are adjusted by the reproducing device 100 to be usedfor a low resolution, sizes of the subtitles or menus may beappropriately maintained.

FIG. 26B illustrates the HD display device 300 that is connected to thereproducing device 100. In this case, the reproducing device 100 scalesdown a UHD image to be appropriate for a display size of the HD displaydevice 100. The reproducing device 100 mixes subtitles with thedown-scaled video frame and provides the video frame to the HD displaydevice 300. The HD display device 300 receives a uncompressed videoframe through an HDMI and outputs the uncompressed video frame on ascreen. As a result, a video frame 2610 of the UHD image is scaled downto be appropriate for an HD size. Also, since HD subtitles 2620 areused, the HD subtitles 2620 have the same sizes as original subtitles orare not greatly scaled down. Therefore, the user may easily identify thesubtitles.

Various types of information may be stored on the disc 10, i.e., arecording medium, so that the reproducing device 100 performs theabove-described operation.

In detail, in the present exemplary embodiment, the disc 10 may store ahigh-resolution content, type information indicating a type of thehigh-resolution content, a first object, a first navigation program forusing the first object, a second object, and a second navigation programfor using the second object.

The high-resolution content refers to a content such as theabove-described UHD image. The type information is informationindicating whether the content is a UHD content or an HD content.

As described above, the reproducing device 100 requires displaycharacteristic information to check whether a screen to display thecontent is a high-resolution screen or an HD screen. The displaycharacteristic information may be regarded as information necessary forselecting and outputting an object appropriate for the screen, but thetype information may be information that may be selectively recorded.

Also, the first object may refer to a high-resolution object, i.e., aUHD object, and the second object may refer to a low-resolution object,i.e., an HD object. Each of the first and second objects may include atleast one of subtitles and menus. The first object may be stored as animage data form but is not limited thereto. In other words, the firstobject may be stored as a text form.

The first navigation program refers to a program that navigates thecontroller 130 to recognize that the first object is the high-resolutionobject and use the first object. The second navigation program refers toa program that navigates the controller 130 to recognize that the secondobject is the low-resolution object and use the second object.

The controller 130 may check a type of a content of the disc 10 usingthe type information. The controller 130 checks an output resolutionbased on display characteristic information of the display device 200 or300 to determine whether to normally output the content recorded on thedisc 10 through the UHD display device 200 or the HD display device 300.

If a connected display device is the UHD display device 200, thecontroller 130 selects and processes the first object using the firstnavigation program. If the connected display device is the HD displaydevice 300, the controller 130 selects and processes the second objectusing the second navigation program. A navigation program refers to aprogram that is written and provided by a content maker so as to selectand output a UHD object or an HD object using a navigation command formanaging a disc. The content maker may provide navigation informationincluding an identifier for identifying whether each of subtitles is anHD subtitle or a UHD subtitle, instead of the navigation program.Therefore, according to another exemplary embodiment, instead of thefirst and second navigation programs, first and second navigationinformation may be recorded on the disc 10

As described above, the type information is option information that maybe selectively recorded. Thus, the content maker may not record the typeinformation of the content.

If the content maker does not record the type information of thecontent, the controller 130 may perform the above-described operationwith respect to objects except an image content, based on informationreflecting a characteristic of the display device.

For example, if the reproducing device 100 is connected to the HDdisplay device 300, the controller 130 controls the data processor 120not to determine whether the content is a UHD content or an HD content,and to add HD subtitles or HD subtitles to a video frame. If thereproducing device 100 is connected to the UHD display device 200, thecontroller 130 controls the data processor 120 to select an object suchas subtitles or menus as a UHD object and add the UHD object to thevideo frame. As a result, if the type information does not exist, thecontroller 130 does not process an image but adjusts only an objectaccording to a screen size.

FIG. 27 is a view illustrating an operation of the reproducing device100 according to the above-described exemplary embodiment. Referring toFIG. 27, the data processor 120 of the reproducing device 100 includes ascaler 121 and a mixer 122.

The scaler 121 scales a video frame of a high-resolution content storedon the disc 10. The mixer 122 selectively detects one of first andsecond objects stored on the disc 10, and mixes the selected object withthe video frame scaled by the scaler 121.

If a display device is connected to the reproducing device 100 throughthe interface unit 140, the controller 130 receives displaycharacteristic information and stores the display characteristicinformation in the storage unit 150. As described above, the displaycharacteristic information may be EDID, etc. If it is determined thatthe HD display device 300 is connected to the reproducing device 100,based on the display characteristic information, the controller 130controls the scaler 121 to scale down the video frame of thehigh-resolution content according to an output resolution of the HDdisplay device 300.

The controller 130 loads the second navigation program stored on thedisc 10 into the storage unit 150. The controller 130 may include amicrocomputer or a central processing unit (CPU), and the storage unit150 may include various types of memories such as a read only memory(ROM), a random access memory (RAM), a flash memory, a hard disc drive(HDD), etc. The controller 130 controls the mixer 122 to detect thesecond object from a storage position of the second object by using thesecond navigation program and mix the second object with the video framescaled by the scaler 121. The interface unit 140 transmits the videoframe, which has been mixed with the second object by the mixer 122, tothe HD display device 300. Therefore, the HD display device 300 maydisplay a screen on which a low-resolution object 2620 is added to adown-scaled vide frame 2610 of the high-resolution content.

If it is determined that the UHD display device 200 is connected to thereproducing device 100, the controller 130 controls the scaler 121 toscale a UHD image frame according to a size of the UHD display device200, and controls the mixer 122 to mix the first object, i.e., the UHDobject, with the UHD image frame.

As described above, according to an exemplary embodiment, objects, suchas subtitles or menus, are respectively provided as a high-resolutionobject and a low-resolution object, and then stored on the disc 10. Thereproducing device 100 appropriately selects such an object according toan output resolution to increase discrimination.

A storage capacity of the disc 10 may lack storage to store all of thehigh-resolution and low-resolution objects. Therefore, thelow-resolution object may be provided using an additional server device.

FIGS. 28A and 28B are views illustrating an operation of the reproducingdevice 100 that provides an object adjusting service, according toanother exemplary embodiment. In the exemplary embodiment of FIGS. 28Aand 28B, a recording medium may store a high-resolution content, typeinformation indicating a type of the high-resolution content, ahigh-resolution object, and address information. The additionalinformation refers to address information about a server device thatprovides a low-resolution object. The address information may be storedas identification information such as an URL, an IP address, a servername, etc., of the server device or a JAVA program. In general, a timewhen releasing a movie using a recording medium of an optical disc typemay be a time that does not become 1 month after the movie is shown in atheater. It may be difficult to form subtitles or menus corresponding tovarious display environments within such a short time. Therefore, afterthe optical disc is first released, the subtitles or menus may beprovided using the server device

FIG. 28A illustrates the reproducing device 100 that plays a UHD contentand is connected to the UHD display device 200. In this case, UHDsubtitles, i.e., a high-resolution object, stored on the disc 10 areused as they are. Therefore, the UHD display device 200 displays a UHDimage frame 210 to which UHD subtitles 220 have been added.

FIG. 28B illustrates the reproducing device 100 that plays a UHD contentand is connected to the HD display device 300. In this case, thereproducing device 100 accesses the server device 1000 using the addressinformation stored on the disc 10 to receive the low-resolution object.The received low-resolution object is added to a video frame that hasbeen scaled down, and then provided to the HD display device 300.Therefore, HD subtitles 2620 and a video frame 2610 matching with anoutput resolution and a display size of the HD display device 300 aredisplayed.

FIG. 29 is a view illustrating an internal structure of the reproducingdevice 100 of FIG. 28, according to an exemplary embodiment. Referringto FIG. 29, the reproducing device 100 further includes the communicator160 and an object storage unit 170, besides the input unit 105, the dataprocessor 120, the controller 130, the driver 110, the interface unit140, and the storage unit 150.

The communicator 160 communicates with an external server device usingthe address information stored on the disc 10. The communicator 160 mayaccess the external server device using WiFi, IEEE, Bluetooth, an LAN,etc. The external server device may be a server device that is operatedby a content maker, a reproducing device manufacturer, a display devicemanufacturer, etc.

If a low-resolution object is downloaded from the server device, thecommunicator 160 stores the low-resolution object in the object storageunit 170. The object storage unit 170 is provided separately from thestorage unit 150 in FIG. 29, but may be included in the storage unit150.

The data processor 120 may include the scaler 121 and the mixer 122. Ifit is checked that the output resolution is a low resolution based ondisplay characteristic information, the controller 130 controls thecommunicator 160 to receive the low-resolution object from the serverdevice 1000 using the address information. Therefore, if thelow-resolution object is received and stored in the object storage unit170, the controller 130 controls the scaler 121 to scale down a videoframe of a content. The controller 130 controls the mixer 122 to add thelow-resolution object stored in the object storage unit 170 to thedown-scaled video frame.

If it is checked that the output resolution is a high resolution, thecontroller 130 controls the mixer 122 to mix UHD subtitles stored on thedisc 10 with a UHD image frame.

Therefore, objects, such as subtitles or menus, may be displayed informs matching with an output characteristic of a display device.

Differently from the above-described exemplary embodiments, ahigh-resolution object may be scaled to generate a low-resolutionobject.

FIGS. 30A, 30B, and 30C are views illustrating the operation of thereproducing device 100 that provides an object adjusting server,according to another exemplary embodiment. According to the presentexemplary embodiment, a recording medium 10, such as a disc, may store ahigh-resolution content, type information indicating a type of thehigh-resolution content, a high-resolution object, and object outputmode (or subtitle or menu output mode) information.

The object output mode information is information indicating whether thehigh-resolution object is allowed to be scaled. In other words, theobject output mode information may include a bit value corresponding to“Yes” or a bit value corresponding to “No”. The object output modeinformation may be determined by an intention of a content maker. Inother words, a maker may not want to determine and process a differencebetween a content and a viewing environment in the reproducing device100. An element that controls the maker not to scale an object may beprovided in consideration of this case, and the object output modeinformation may operate as the element.

FIG. 30A illustrates the UHD display device 200 that is connected to thereproducing device 100. In this case, the controller 130 adds UHDsubtitles 220 to a UHD image frame 210 without checking the objectoutput mode information and provides the UHD image frame 210, to whichthe UHD subtitles 220 have been added, to the UHD display device 200.

FIGS. 30B and 30C illustrate the HD display device 300 that is connectedto the reproducing device 100. In this case, the controller 130 checksthe object output mode information. If the object output modeinformation has the value corresponding to “No”, the controller 130scales down a high-resolution object 2620 by 1/4 times, adds thedown-scaled high-resolution object 2620 to the UHD image frame 210, andprovides the UHD image frame 210, to which the down-scaledhigh-resolution object 2620 has been added, to the HD display device300. In this case, since subtitles are scales at the same ratio as animage frame as shown in FIG. 30B, the subtitles are displayed in verysmall sizes.

If the object output mode information has the value corresponding to“Yes”, the controller 130 scales down the high-resolution object inconsideration of an output resolution and a display size of the HDdisplay device 300. In this case, as shown in FIG. 30C, subtitles 2620are converted in appropriate sizes, added to the video frame 2610 thathas been scaled down, and then provided to the HD display device 300.

FIG. 31 is a view illustrating an internal structure of the reproducingdevice 100 of FIG. 30, according to an exemplary embodiment. Referringto FIG. 31, the data processor 120 includes a first scaler 121, a mixer122, and a second scaler 123.

The first scaler 121 scales a video frame of a high-resolution content.The second scaler 123 scales a high-resolution object. The mixer 122mixes the video frame output from the first scaler 121 with the objectoutput from the second scaler 123.

If it is checked that an output resolution of a display panel is a lowresolution, based on display characteristic information, the controller130 checks object output mode information. If the object output modeinformation has a value corresponding to “Yes”, the controller 130determines that the object has been allowed to be scaled. Therefore, thecontroller 130 controls the data processor 120 to respectively scale andmix the video frame and the high-resolution object of thehigh-resolution content. A scaling ratio of the high-resolution objectmay be determined based on a display size of the display device and anobject size. This will be described in detail later with reference tothe attached drawings.

If the object output mode information has a value corresponding to “No”,the controller 130 determines that the object has not been allowed to bescaled. Therefore, the controller 130 controls the data processor 120 toscale down a video frame of a high-resolution content and mix thedown-scaled video frame with the high-resolution object.

If the high-resolution object is scaled down, the controller 130 mayadjust a down-scaling ratio not to excessively scale down thehigh-resolution object.

FIGS. 32A and 32B are views illustrating a method of adjusting a scalingratio of an object in consideration of a display size according to anexemplary embodiment. The controller 130 of the reproducing device 100may perform a scale control operation with respect to an object such assubtitles or menus. If the scale control operation refers to anoperation in which a content maker scales the object with changing thescaling ratio to maximally display the object on a screen of the HDdisplay device 300 using sizes and position information of subtitlesprovided based on a UHD screen.

If a down-scaling ratio is set to be low, e.g. 4, the subtitles 2620 aredisplayed very small as shown in FIG. 32A. If the down-scaling ratio isset to be too low, a width of high-resolution subtitles is wider than awidth of the HD display device 300 Thus, some of the subtitles may becut. Therefore, the controller 130 may compare an actual width ofhigh-resolution subtitles with a horizontal width of the HD displaydevice 200 to adjust the down-scaling ratio.

As shown in FIGS. 32A and 32B, if a width of the subtitles 220 is x inthe UHD display device 200, and x is sufficiently small, the controller130 may set the down-scaling ratio to 1:1. Therefore, subtitles may beviewed in actual sizes in the HD display device 300. However, if x issufficiently great, the controller 130 may scale the subtitles at adown-scaling ratio of y/x, and add the down-scaled subtitles to a videoframe. A size of y may be determined as a slightly smaller value thanthe horizontal width of the HD display device 300. In FIG. 32B, y is setto about 1080 pixels. Therefore, whole subtitles may not be cut and maybe displayed in sizes easily identifiable by a user.

As described above, the controller 130 may adaptively determine ascaling ratio in consideration of a display size and an object size.

Also, in the above-described exemplary embodiments, a disc has been usedas an example of a recording medium. A high-capacity recording mediumthat may store a UHD content like a BD, a holographic disc, etc., may beused. Such a recording medium may record various types of information,as described above according to exemplary embodiments. In theabove-described exemplary embodiment, the first and second navigationprograms may be stored on the recording medium. However, instead ofprogram forms, navigation information such as an identifier may bestored on the recording medium and then provided to the controller 130.

A storage area of the recording medium may be divided into a pluralityof storage areas according to types of recorded information. Forexample, the recording medium may include a first storage area in whicha high-resolution content is stored, a second storage area in which typeinformation indicating a type of the high-resolution content, a thirdstorage area in which a high-resolution object is stored, and a fourthstorage area in which additional information for displaying an object isstored.

The additional information may vary according to exemplary embodiments.For example, according to exemplary embodiments, the additionalinformation may include at least one or more information of a firstnavigation program or navigation information, a low-resolution object, asecond navigation program or navigation information for indicating thelow-resolution object, address information about a server deviceproviding the low-resolution object, and object output mode informationindicating whether scaling control is to be performed with respect to ahigh-resolution object. Also, the recording medium may additionallystore a type of each stored information, an identifier of eachinformation, metadata recording a position, etc. of a storage areastoring each information, etc.

FIG. 33 is a view illustrating a stream structure of a recording mediumthat stores a low-resolution object such as HD subtitles or HD menus,according to an exemplary embodiment.

Referring to FIG. 33, a recording medium 10 according to the presentexemplary embodiment further includes a subtitle stream #2 1350, UHDsubtitle data 1351 in a men stream #2 1380, HD subtitle data 1352 exceptUHD menu data 1381, and HD menu data 1382. Therefore, a reproducingdevice may selectively output the subtitle stream #2 of the recordingmedium 10 and a UHD object or an HD object in the menu stream #2 1380according to a viewing environment.

FIG. 34 is a view illustrating an information structure of a recordingmedium that stores a low-resolution object as shown in FIG. 33,according to an exemplary embodiment.

Referring to FIG. 34, information, such as “is_Subtitle_for_HD_Viewing”,is provided in a playlist layer of the recording medium to displaywhether HD viewing environment subtitles of UHD play items exist.

A reproducing device having a structure as illustrated in FIG. 27 mayprocess subtitles or menus using a recording medium having a datastructure as illustrated in FIGS. 32A through 34.

The data structure of FIGS. 32A through 34 will be described as anexample. A current play item #0 is played. A user may select a subtitlestream number 2 through a remote controller or other input units. Inthis case, the reproducing device 100 selects the subtitle stream number2 according to a selection of the user. The reproducing device 100determines whether a current output situation is an HD viewingenvironment. In the present exemplary embodiment, a viewing environmentis an HD viewing environment. A method of determining the viewingenvironment has been described above. Thus, repeated description isomitted.

In this case, the reproducing device 100 analyzes STN_Table of the playitem #0 of file 00000.mpls to check that a stream ID of subtitles to beplayed is 1. If the viewing environment is a UHD viewing environment, anoperation of the reproducing device 100 for selecting subtitles iscompleted. However, if the viewing environment is an HD viewingenvironment, the reproducing device 100 proceeds to a next operation. Inother words, the reproducing device 100 checks UHD extension of the file00000.mpls to checks whether subtitles used for the HD viewingenvironment exist. Also, reproducing device 100 finally determines astream ID that is to be used for playing. The reproducing device 100checks whether information “is_Subtitle_for_HD_Viewing” of a playlistinformation structure has a value corresponding to “Yes” to determinethat a stream ID2 is to be played if the information“is_Subtitle_for_HD_Viewing” has the value corresponding to “Yes”. Ifthe information “is_Subtitle_for_HD_Viewing” has a value correspondingto “No”, the reproducing device 100 determines that a stream ID1 is tobe played. In FIG. 34, “is_Subtitle_for_HD_Viewing” of the stream ID2has the value corresponding to “Yes”, the reproducing device 100 playsthe stream ID2. As a result, HD subtitles are added to a video frame andthen output.

As described above, an object such as subtitles or menus may be made asa bitmap, and then stored on a recording medium. However, exemplaryembodiments are not limited thereto. Therefore, the object may be storedas a text form.

FIGS. 35A and 35B are views illustrating stream structures of arecording medium that stores subtitles and menus made in a text form.Referring to FIGS. 35A and 35B, a recording medium 10 according to thepresent exemplary embodiment stores a video frame 1510, audio streams #1and #2 1520 and 1530, a subtitle stream #1 1540, and a subtitle stream#3 1560, as in a related art stream structure. However, a subtitlestream #1550 is different.

In other words, a related art recording medium includes only UHD textdata 1552 in a subtitle stream #2 1550 and UHD style data 1551. However,the recording medium 10 further includes HD style data 1553

The UHD text data 1552 includes a code value of a character such asletters or numbers constituting subtitles. Style data indicates a stylein which a corresponding text is output. If the UHD display device 200is connected to the reproducing device 100, the reproducing device 100processes the UHD text data 1552 using the UHD style data 1551 togenerate UHD subtitles. If the HD display device 300 is connected to thereproducing device 100, the reproducing device 100 processes the UHDtext data 1552 using HD style data 1553 to generate HD subtitles.

An information structure illustrated in FIG. 34 may be used in arecording medium. In other words, if “is_Subtitle_for_HD_Viewing” has avalue corresponding to “Yes”, and a viewing environment is an HD viewingenvironment, the controller 130 of the reproducing device 100 uses theHD style data 1553 to generate subtitles. If not, the reproducing device100 uses the UHD style data 1551 to generate subtitles.

Only a subtitle stream is illustrated in FIGS. 35A and 35B, but a menustream may also be processed according to a similar method to thesubtitle stream.

As described above, an operation and a detailed structure of areproducing device that provides an object adjusting service accordingto various exemplary embodiments has been described. A method ofprocessing a content in a reproducing device according to exemplaryembodiments will now be briefly described with reference to flowcharts.

FIG. 36 is a flowchart illustrating a method of processing a content ina reproducing device that is realized as a reproducing device thatperforms reproduction with respect to a recording medium, according toan exemplary embodiment. Referring to FIG. 36, if a recording medium isattached in operation S1610, the reproducing device checks a viewingenvironment of a display device connected to the reproducing device todetermine whether an output resolution is a low resolution in operationS1620.

If it is determined in operation S1620 that the viewing environment isthe low resolution, the reproducing device scales down a high-resolutioncontent and adds a low-resolution object to the high-resolution contentthat has been scaled down, in operation S1630. The low-resolution objectmay be acquired according to various methods described above. Inoperation S1650, the reproducing device provides a video frame, to whichthe low-resolution object has been added, to the display device.

If the output resolution is a high resolution matching contentprocessing, the reproducing device adds the high-resolution object to ahigh-resolution video frame in operation S1640, and provides thehigh-resolution video frame to the display device in operation S1650.

As described above, subtitles or menus having forms matching with aresolution of the display device may be displayed. Thus, anidentification may be improved.

As described above, a method of acquiring a low-resolution object mayvary according to exemplary embodiments. An operation of generating alow-resolution object and mixing the low-resolution object with a videoframe will now be described according to exemplary embodiments.

FIG. 37 is a flowchart illustrating a processing method for providing anobject adjusting service according to an exemplary embodiment. Referringto FIG. 37, in operation S1710, a reproducing device demultiplexes ahigh-resolution content to detect video data, decodes the video data togenerate a video stream, and scales the video stream to generate a videostream in a size that may be displayed in a low-resolution displaydevice.

In operation S1720, the reproducing device detects a low-resolutionobject stored on a recording medium using a navigation program ornavigation information stored on the recording medium. If the navigationprogram is used, the controller 130 of the reproducing device may loadthe navigation program into an RAM to execute the navigation program,and detect an object according to the navigation program. If thenavigation information is used, the controller 130 analyzes thenavigation information to check a position in which the low-resolutionobject is stored and reads an object from the position.

In operation S1730, the reproducing device mixes the detectedlow-resolution object with a video frame. A buffer, etc., may be used ina mixing process. In the above-described exemplary embodiments,descriptions of subsidiary elements are omitted.

FIG. 38 is a flowchart illustrating a processing method for providing anobject adjusting service according to another exemplary embodiment.Referring to FIG. 38, in operation S1810, the reproducing device scalesdown a video frame of a high-resolution content. In operation S1820, thereproducing accesses a server device using address information stored ona recording medium. The server device may transmit data about alow-resolution object corresponding to the high-resolution content. Inoperation S1830, the reproducing device receives and stores thetransmitted low-resolution object. In operation S1840, the reproducingdevice detects an object stored at a time to display the object andmixes the object with the video frame.

FIG. 39 is a flowchart illustrating a processing method for providing anobject adjusting service according to another exemplary embodiment.Referring to FIG. 39, in operation S1910, the reproducing device scalesdown a video frame of a high-resolution content. In operation S1920, thereproducing device checks object output mode information stored on arecording medium. If a scaling control is allowed in operation S1930,the reproducing device scales a high-resolution object in a scalingration that is set according to a display size and an object size, inoperation S1940. A principle and a method for setting the scaling ratiohave been described in detail with reference to FIGS. 32A and 32B. Thus,repeated descriptions are omitted. In operation S1950, the reproducingdevice mixes the scaled object with the video frame.

If the scaling control is not allowed in operation S1930, thereproducing device scales down a high-resolution object according to anoutput resolution in operation S1960. In this case, if a UHD content isconnected to an HD display device, subtitles or menus may be scaled downin a ratio of about 1/4.

In FIGS. 37 through 39, processing of a video frame is performed priorto processing of an object. However, processing orders may be variouslychanged according to products. For example, object processing may befirst performed, and then video frame processing may be performed.Alternatively the object processing and the video frame processing maybe performed in parallel. Also, in FIGS. 37 through 39, thelow-resolution display device is connected. An operation performed whena high-resolution display device is connected has been described above.Thus, repeated description is omitted.

In the above-described exemplary embodiments, a structure and anoperation of a reproducing device that performs reproducing with respectto a recording medium has been described. However, the reproducingdevice may be realized as a display device. For example, the reproducingdevice may be realized as a TV. In this case, a high-resolution contentmay not be played through a recording medium, but may be receivedthrough a broadcasting network.

FIG. 40 is a block diagram illustrating a structure of the reproducingdevice 100 that is realized as a display device, according to anexemplary embodiment. Referring to FIG. 40, the reproducing deviceincludes an input unit 105, a data processor 120, a controller 130, areceiver 195, and a display unit 190.

The receiver 195 may have different structures according to abroadcasting communication standard that is used in a nation that usesthe reproducing device. Currently, there are various types of digitalbroadcasting standards, such as ATSC, DVB, and ISDB-T methods, etc. Ifthe ATSC standard is used, the receiver 195 may include an antenna, anRF down-converter, a demodulator, an equalizer, etc. The data processor120 may include a demultiplexer, an RS decoder, a deinterleaver, etc. Adetailed structure for transmitting and receiving a signal according toeach broadcasting standard is disclosed in a standard document of eachbroadcasting standard. Thus, detailed illustration and description areomitted.

The receiver 195 receives a signal including a high-resolution contentthrough a broadcasting network, and inputs the signal into the inputunit 105.

The input unit 105 transmits the high-resolution content to the dataprocessor 120.

The display unit 190 includes a display panel 191. Therefore, in thepresent exemplary embodiment, the controller 130 may immediately check acharacteristic of a display panel of an external device, i.e., a viewingenvironment, using spec information recorded in an internal memory or astorage unit without checking the characteristic of the display panel.

If the display panel 191 is used for a low resolution, and it isdetermined that the high-resolution content has been received throughthe receiver 195, the controller 130 controls the data processor 120 toperform operations according to the above-described exemplaryembodiments.

The display unit 190 displays a video frame, to which a low-resolutionobject has been added, through the display panel 191. The display unit190 may further include a backlight unit or other driving circuits,besides the display panel 191. However, detailed illustration anddescription are omitted.

As shown in FIG. 40, a high-resolution content is provided through abroadcasting network, additional information may be recorded in variousfields of a broadcasting signal and then transmitted. For example, alow-resolution object may be transmitted in an independent elementarystream (ES) form like a video stream, an audio stream, a high-resolutionsubtitle data, etc., and other types of information may be transmittedaccording to various methods such as a TVCT, an EIT, a PMT, a metadatastream, etc.

If the recording medium 10 is realized as a BD, data may be recorded ina form compatible with Blue-ray standards to provide such a service.These types of data may be recorded in various parts of the recordingmedium 10. A syntax of these types of data and a method of recordingthese types of data will now be described.

As described above, the recording medium 10 may be realized as a BD. Asdescribed above with reference to FIG. 10, the BD includes four layerssuch as an index table 1110, a movie object/BD-J object 1120, a playlist1130, and a clip 1140.

An STN table is recorded in a playlist file. A value of ID1 and a valueof ID2 of extension data of “ext_data_entry( )” may be respectively setto “0x000Y” and “0x000Z” in the playlist file to recognize the extensiondata as “STN_table_UHD( )”. “STN_table_UHD( )” indicates that a UHDvideo exists in a playlist.

If a primer video of the playlist is an MPEG-2 video stream, an MPEG4AVC stream, or a VC-1 video stream, “STN_table_UHD( )” may not exist inthe playlist

“STN_table_UHD” provides the following information:

-   -   First information that defines a coded structure of a video        sequence to perform a uniform trick play job on players.    -   Second information that defines an interested region to        conveniently view a UHD video in an HD viewing environment.    -   Third information that changes a non-video visual content (i.e.,        subtitles, menus, etc.) to conveniently view the non-video        visual content in an HD viewing environment.

In other words, the first information refers to information that is usedin the above-described exemplary embodiments to provide a trick play.The second information refers to information that is used in theexemplary embodiments to provide an interested region enlargementservice. The third information refers to information that is used in theexemplary embodiments to provide an object changing service.

FIG. 41 is a view illustrating a syntax of a table “STN_table_UHD” thatprovides the above-described various types of additional information,according to an exemplary embodiment.

Referring to FIG. 41, in the table “STN_table_UHD”, video output modeinformation “video_output_mode” 4110, information“is_there_interesting_region” 1420 indicating whether an interestedregion exists, the number 4130 and numbers 4140 “Num_of_tiles_of_IR,Tile_num_of_IR[t_id]” of tiles corresponding to the interested region,information “Is_subtitle_for_HD_viewing_env” 4150 indicating whethersubtitles are HD viewing subtitles, information 4160“Is_IG_for_HD_viewing_env”, etc., may be expressed as various bitvalues.

In FIG. 41, the table “STN_table_UHD( )” defines stream numbers of loopsof pi_id values as follows:

Primary_video_stream_number[pi_id] PG_textST_stream_number[pi_id]IG_stream_number[pi_id]

“Primary_video_stream_number[pi_id]” may be calculated as“Primary_video_stream_id+1”. Also, “PG_textST_stream_number[pi_id]” maybe calculated as “PG_textST_stream_id+1”, and “IG_stream_number[pi_id]”may be calculated as “IG_stream_id+1”.

One PG TextST stream entry (i.e., an entry defined in the STN table) anda PG TextST stream related to an HD viewing environment have the samestream number value. Also, one IG stream entry (i.e., an entry definedin the STN table) and an IG stream related to the HD viewing environmenthave the same stream number value.

In FIG. 41, the video output mode information “video_output_mode” 4110may be expressed as various bits like 0 or 1. If the video output modeinformation “video_output_mode” 4110 is 1, an interested region may beextracted and then output to a display device. The video output modeinformation “video_output_mode” 4110 is effective on a playlist. Ahorizontal display size of Player Status Registers 23 (PSR23) becomes acriterion to determine whether a current viewing environment is a UHD orHD viewing environment. The PSR23 are used for a profile 5 player and aprofile ZZ player

The information “Is_there_interesting_region” 4120 indicates whether theinterested region exists. If the interested region exists in a frame ofa play item, the information “Is_there_interesting_region” 4120 isrecorded as 1

The number “Num_of_tiles_of_IR” 4130 is information indicating how manytiles exist in the interested region, and the numbers“Tile_num_of_IR[t_id]” 4140 is information indicating tile numbers inthe interested region.

If the PG TextSt stream of “PG_textST_stream_id” is provided to bedisplayed in an HD viewing environment, the information“Is_subtitle_for_HD_viewing_env” 4150 may be set to 1. If the IG streamof “IG_stream_id” is provided to be displayed in the HD viewingenvironment, the information “Is_IG_for_HD_viewing_env” 4160 may be setto 1.

Various types of information as described above may be included in aclip information file recorded on a BD.

FIG. 42 is a view illustrating a syntax of “CPI_UHD( )” of a clipinformation file, according to an exemplary embodiment. In“ext_data_entry( )”, values of ID1 and ID2 of extension data may berespectively set to “0x000x” and “0x000y” to identify the extension dataas “CPI_UHD( )”.

If a corresponding clip AV stream file includes an HEVC video stream,“CPI_UHD( )” may exist in “ExtensionData( )” of the clip informationfile. If not, any “CPI_UHD( )” may not exist in “ExtensionData( )” ofthe clip information file.

In FIG. 42, a length field includes 32 bits indicating the number ofbytes from “CPI_UHD( )” right after the length field to last “CPI_UHD()”.

“CPI_type” may be set to 1 which indicates that a type of a CPI database(DB) is “EP_map_type”

“Number_of frames_in_GOP” indicates the number of frames of a GOP. If avideo sequence is a field format, a complementary field pair may beregarded as frames, and may be smaller than or equal to the maximumnumber of video frames displayed in the GOP. “Number_of_frames” may notbe changed in one clip.

If a Br frame exists in the GOP, “is_Br_present” may be set to 1. IfBr_present is set to 1, all GOPs in a sequence may have Br frames.

“Number_of B_frames” indicates the number of B pictures between I and Pframes, right before and after the I and P frames. This value may begreater than or equal to 1, or may be smaller than or equal to 3.“Number_of_B_frames” may not be changed in one clip

“Padding_word” indicates zero or more parentheses that may be insertedaccording to a definition of “CPI_UHD( )”. “N1” may be an arbitrarypositive number corresponding to a 32-bit arrangement state of theabove-described length field. “Padding_word” may have an arbitraryvalue.

FIG. 43 is a view illustrating a syntax of “EP_map_UHD( )” according toan exemplary embodiment. Referring to FIG. 43, the syntax of“EP_map_UHD( )” has information “Trick_play_info” and information“EP_map_for_UHD_trickplay_PID(EP_stream_type, Nf)”, besides “EP_map( )”defined in existing Blue-ray standards.

FIG. 44 is a view illustrating a syntax of “EP_map_for_UHD_trickplay”according to an exemplary embodiment. In FIG. 44, a length fieldincludes 32 bits indicating the total number of bits from a bit rightafter the length field to a last bit

“Position_of_Br” indicates a position of a Br frame of consecutive Bsframes. Three consecutive Bs frames may exist. Thus, “Position_of_Br”may be one of 0, 1, and 2 respectively indicating first one, second one,and third one of consecutive B2 frames.

“Temporal_ids” indicates a temporal ID of an I or P frame. In anexemplary embodiment for performing a trick play as described above, adetermination may be made as to which P picture may be skipped or whichP picture may be read and decoded according to a play speed.“N_of_key_frames_in_GOP” may be calculated using Equation 1 below:

N_of_key_frames_in_GOP = number_of_frames_in_GOP/(1 +number_of_B_pictures) . . . (1)

In equation 1 above, “number_of_frames_in_GOP” and“number_of_B_pictures” are defined in “CPI_UHD( )” For example, if a GOPincludes 24 frames, and the number of consecutive B frames is 3, thenumber of key frames of one GOP is 6.

“Immediately_following_key_frame_offset” refers to an offset from animmediately preceding I or P frame according to a decoding order. Also,“key_frame_size” refers to a coding size of an I or P picture.

FIGS. 45 and 46 are views illustrating a player state register for UHDplaying according to various exemplary embodiments.

FIG. 45 illustrates a structure of PSR21. The PSR21 includes HD portionoutput mode preference information. In FIG. 45, if the HD portion outputmode preference information is 0b, a full HD frame is decoded andoutput. If the HD portion output mode preference information is 1b, anHD part of the UHD frame is decoded and output.

Only the HD portion output mode preference information is illustrated inFIG. 45, but output mode preference information may also be includedaccording to another exemplary embodiment. If the output mode preferenceinformation is 0b, the output mode information indicates a 2D outputmode. If the output mode preference information is 1b, the output modepreference information indicates a stereoscopic output mode.

FIG. 46 illustrates a structure of PSR23. The PSR23 indicates acharacteristic value of a display connected to a BD-ROM player.Referring to FIG. 46, information, such as a horizontal display size,may be recorded in the PSR23. The horizontal display size is informationthat indicates a horizontal size of the connected display expressed in acentimeter unit. The horizontal display size may be recorded as variousvalues such as “0x001” through “0xFFE) according to the horizontal sizeof the connected display. “0xFFE” indicates a horizontal length of 4094cm. “0x000” is not defined, and “0xFFF” indicates a horizontal lengthgreater than 255 cm.

If a display device does not provide a value through an interface, aBD-ROM player, i.e., the reproducing device 100 may automatically set avalue thereof before starting playing. If the value is not automaticallyset, the value may be set by a user.

According to exemplary embodiments, only one of the above-describedservices may be provided in one reproducing device, but a plurality ofservices may be supported in one reproducing device. In this case, aservice may be selectively provided according to a selection of a user.If a user command to select one of a trick play service, an interestedregion enlargement service, and an object adjusting service is input,the controller 130 of the reproducing device 100 detects additionalinformation corresponding to the selected service.

As described above, if a recording medium is a BD that includes fourlayers such as an index table, a movie object/BD-J object, a playlist,and a clip, additional information may be recorded in at least one of atable “STN_table_UHD” included in a playlist file, and “CPI_UHD( )” and“EP_map_for_UHD_trickplay” recorded in a clip file. The additionalinformation may also be provided in various forms.

The controller 130 may detect additional information corresponding to aservice selected by the user from such additional information andprovide a service using the detected additional information. A method ofproviding a service has been described in detail in the above-describedexemplary embodiments. Thus, repeated description is omitted.

According to various exemplary embodiments as described above, data forproviding various services may be recorded on a recording mediumaccording to a preset structure. Also, a reproducing device may providevarious services by using the data.

As described above, according to various exemplary embodiments, varioustypes of services, such as a trick play service, an interested regionenlargement service, an object adjusting service, etc., may be providedby using additional information stored on a recording medium.

Methods of providing a service according to the above-describedexemplary embodiments may be respectively coded as software, and thenrecorded on a non-transitory computer-readable medium.

For example, if a recording medium that records video data encodedaccording to an HEVC method and additional information is attached, aservice providing method may include: loading the recording medium, andproviding a service corresponding to the additional information. Theservice may include at least one of a trick play service, an interestedregion enlargement service, and an object adjusting service.

The non-transitory computer-readable medium may be attached in varioustypes of devices such as a reproducing device, a display device, etc.Therefore, the above-described services may be provided in the varioustypes of devices.

The non-transitory computer-readable medium refers to a medium whichdoes not store data for a short time such as a register, a cache memory,a memory, etc., but semi-permanently stores data and is readable by adevice. The above-described applications or programs may be stored andprovided on a non-transitory computer readable medium such as a CD, aDVD, a hard disk, a blue-ray disk, a universal serial bus (USB), amemory card, a ROM, etc.

The foregoing exemplary embodiments and advantages are merely exemplaryand are not to be construed as limiting. The present teaching can bereadily applied to other types of apparatuses. Also, the description ofthe exemplary embodiments is intended to be illustrative, and not tolimit the scope of the claims. Many alternatives, modifications, andvariations will be apparent to those skilled in the art.

What is claimed is:
 1. A reproducing device comprising: a driverconfigured to load a recording medium in response to the recordingmedium being attached, wherein the recording medium records video dataand additional information encoded according to a High Efficiency VideoCoding (HEVC) method; a data processor configured to process the videodata; a controller configured to provide a service corresponding to theadditional information, wherein the service comprises at least one of atrick play service, an interested region enlargement service, and anobject adjusting service.
 2. The reproducing device of claim 1, whereinthe recording medium is a blue-ray disc (BD) which is divided into fourlayers including an index table, an object/BD-J object, a playlist, anda clip file, wherein the additional information is recorded in at leastone of a STN-table_UHD table comprised in the playlist, CPI_UHD( )recorded in the clip file, and EP_map_for_UHD_trickplay recorded in theclip file.
 3. The reproducing device of claim 1, wherein the controlleris configured to selectively perform the at least one of the trick playservice, the interested region enlargement service, and the objectadjusting service according to a user selection.
 4. A method ofproviding a service, the method comprising: loading a recording mediumin response to the recording medium being attached, wherein therecording medium records video data and additional information encodedaccording to a High Efficiency Video Coding (HEVC) method; providing aservice corresponding to the additional information, wherein the servicecomprises at least one of a trick play service, an interested regionenlargement service, and an object adjusting service.
 5. The method ofclaim 4, wherein the recording medium is a blue-ray disc (BD) which isdivided into four layers including an index table, an object/BD-Jobject, a playlist, and a clip file, wherein the additional informationis recorded in at least one of a STN-table_UHD table comprised in theplaylist, CPI_UHD( ) recorded in the clip file, andEP_map_for_UHD_trickplay recorded in the clip file.
 6. The method ofclaim 4, further comprising: detecting additional informationcorresponding to a selected service from the recording medium inresponse to the at least one of the trick play service, the interestedregion enlargement service, and the object adjusting service beingselected according to a user selection.
 7. A trick play method of areproducing device, the method comprising: loading a recording mediumwhich stores video data and additional information of a plurality offrames; determining whether a trick play command has been input;detecting the additional information of the plurality of frames inresponse to determining that the trick play command has been input;selecting at least one layer of the plurality of frames based on theadditional information of the plurality of frames; decoding data of theat least one layer and outputting at least a portion of the decodeddata; and performing a trick play in response to the at least a portionof the decoded data being output.
 8. The method of claim 7, wherein thetrick play comprises a trick play speed designated by the trick playcommand.
 9. The method of claim 7, wherein the plurality of frames areclassified into a plurality of layers.
 10. The method of claim 7,wherein the additional information is encoded according to a HighEfficiency Video Coding (HEVC) method.